-- Logs begin at Wed 2022-05-18 13:17:03 UTC, end at Wed 2022-05-18 14:38:44 UTC. -- May 18 13:54:07.419216 dv-cinder-755101-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 18 13:54:07.428412 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 13:54:07 2022] *** May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: nodename: dv-cinder-755101-9-iscsi May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: machine: x86_64 May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: clock source: unix May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: pcre jit disabled May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: detected number of CPU cores: 4 May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: current working directory: / May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: detected binary path: /usr/bin/uwsgi-core May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: your processes number limit is 47680 May 18 13:54:07.431029 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: your memory page size is 4096 bytes May 18 13:54:07.431686 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: detected max file descriptor number: 2048 May 18 13:54:07.431686 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: lock engine: pthread robust mutexes May 18 13:54:07.431686 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: thunder lock: enabled May 18 13:54:07.431686 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 18 13:54:07.431686 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 13:54:07.477130 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: Python main interpreter initialized at 0x55576695c9c0 May 18 13:54:07.477130 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: python threads support enabled May 18 13:54:07.477130 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: your server socket listen backlog is limited to 100 connections May 18 13:54:07.477130 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: your mercy for graceful operations on workers is 90 seconds May 18 13:54:07.477480 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: mapped 403077 bytes (393 KB) for 2 cores May 18 13:54:07.477556 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: *** Operational MODE: preforking *** May 18 13:54:07.477823 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: *** uWSGI is running in multiple interpreter mode *** May 18 13:54:07.477823 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: spawned uWSGI master process (pid: 80319) May 18 13:54:07.478030 dv-cinder-755101-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 18 13:54:07.478584 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: spawned uWSGI worker 1 (pid: 80330, cores: 1) May 18 13:54:07.479074 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: spawned uWSGI worker 2 (pid: 80331, cores: 1) May 18 13:54:07.479234 dv-cinder-755101-9-iscsi devstack@keystone.service[80319]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 13:54:13.218065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 13:54:13.218065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: from cryptography.utils import int_from_bytes May 18 13:54:13.218888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 13:54:13.218888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: from cryptography.utils import int_from_bytes May 18 13:54:13.252626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 13:54:13.252626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes May 18 13:54:13.253178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 13:54:13.253178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes May 18 13:54:13.268431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 13:54:13.268624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 13:54:13.268841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] command line args: [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 13:54:13.269111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 13:54:13.269289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ================================================================================ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 13:54:13.269542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] admin_token = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.269785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] config_dir = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.269973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.270154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] config_source = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.270924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] debug = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.271188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_config_append = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.272768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.273006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_dir = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.273161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.273384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.273632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.273880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.274126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.274304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.274480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.274722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.274966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.275201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.275441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.275674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.275906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.276153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.276398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.276682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.277191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.277373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] publish_errors = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.277604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.277832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.278010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.278253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.278486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.278719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] standard_threads = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.278949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.279195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.279364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.279538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] use_journal = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.279714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] use_json = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.279888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] use_stderr = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.280063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] use_syslog = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.280291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.280547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.280801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.281070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.281311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.281560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.281799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.282049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.282288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.282548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.282796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.283048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.283284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.283532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.283769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.284016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.284263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.284502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.285036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.285287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.285524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.285777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.286601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.286855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.287223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.287317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.287552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.287784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.288022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.288272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.288532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.288764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.289020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.289269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.289518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.289760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.290019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.290252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.290491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.290730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.290964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.291198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.291431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.291663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.291963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.292145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.292379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.292621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.292877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.293118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.293355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.293606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.293838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.294079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.294318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.294558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.294797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.295038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.295275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.295527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.295763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.296131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.296367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.296631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.296902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.297138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.297381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.297619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.297887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.298129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.298380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.298628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.298869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.299106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.299343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.299590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.299832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.300071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.300315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.300554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.300812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.301050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.301287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.301544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.301711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 13:54:13.302360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.302505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 13:54:13.302584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.302656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] command line args: [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 13:54:13.302731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.302731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.302907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 13:54:13.302907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ================================================================================ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 13:54:13.303077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.303077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.303215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.303292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.303363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config_dir = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.303363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.303498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.303568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] config_source = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.303638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.303707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] debug = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.303821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.303900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.304051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.304136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.304277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.304364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.304501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.304578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.304741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.304849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.305013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.305099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.305199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_config_append = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.305307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.305403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.305533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.305638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_dir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.305743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.305839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.305940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.306044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.306163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.306273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.306413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.external = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.306526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.306650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.306790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.306877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.306955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.307039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.307170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.307273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.307402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.password = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.307492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.307635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.token = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.307717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.307886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.307974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.308125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.308212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.308357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.308433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.308592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.308686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.308863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.308965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.309115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.309202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.309347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.309585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.309678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.309793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] publish_errors = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.309878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.310032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.310121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.310265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.310354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.310428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.310510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.310678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.310760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.310916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.311004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.311152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] standard_threads = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.311242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.311389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.311470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.311635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.311716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.311872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.311951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.312030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_journal = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.312141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_json = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.312220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.312319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_stderr = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.312408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.312485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] use_syslog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.312643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.312724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 13:54:13.312910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.313980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.314941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.315902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.316897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.317926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.318933 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.319973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.320960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.321903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.322884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.323955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.324997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.325955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.326885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.327988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.328956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.329925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.330909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.331843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.332771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.333489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.333630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.333788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.333869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334437 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.334889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.335999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336587 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.336975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.337927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.338983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.external = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.339921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.password = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] role.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.token = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340553 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] role.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.340883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.341863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342824 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.342976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.343954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.344972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.345960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.346942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.347905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.348071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.348163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.348318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.348413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.349956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.350893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.351855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.352816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.353997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.354982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.355998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.356984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.357922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.358074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.358152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.358304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.358391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.358465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 13:54:13.358537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.358763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.359014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.359260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.359501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.359746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.360000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.360253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.360491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.360727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.361011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.361264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.361505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.361747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.361987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.362223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.362467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.362731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.362967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.363217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.363472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.363721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.363959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.364557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.364557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.364830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.365113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.365355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.365606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.365856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.366105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.366354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.366601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.366834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.367087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.367328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.367569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.367808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.368049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.368299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.368548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.368828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.369071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.369306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.369556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.369796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.370035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.370277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.370526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.370773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.371074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.371315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.371561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.371813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.372065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.372307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.372563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.372841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.373083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.373333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.373592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.373836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.374073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.374324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.374558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.374813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.375065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.375318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.375570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.375820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.376070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.376349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.376604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.376864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.377120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.377371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.377622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.377872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.378292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.378534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.378788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.379040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.379290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.379544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.379827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.380380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.380380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.380558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.380812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.381044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.381279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.381534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.381791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.382044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.382294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.382533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.382769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.383007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.383250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.383507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.383747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.384005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.384255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.384496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.384745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.385035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.385286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.385528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.385772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.386011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.386261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.386513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.386750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.386994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.387305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.387571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.387820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.388074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.388322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.388568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.388829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.389075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.389288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.389376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.389522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.389616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.389750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.389832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.390000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.390249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.390489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.390738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.390977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.391226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.391461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.391705 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.392211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 13:54:13.392386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 13:54:13.399332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.418137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.418367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.418592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.428140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.428282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.430692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.451521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.451754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.482135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.492515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.534405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.534633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.536172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.536412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.601653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.601839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.601932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.602917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.625964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.626949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.627083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.627165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.627295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.627376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.627507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.639195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.639848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.659781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.659923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.660922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.661011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.661141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.661228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 13:54:13.678384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.678589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 13:54:13.678922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.679122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 13:54:13.679236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.679386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 13:54:13.679471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.679644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.679726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.679901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.679986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 13:54:13.680156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.680239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.680416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.680676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.680960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.691101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.691376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.691643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.691922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.694242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.694517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.694786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.695066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.700611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.703943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.704096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.704228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.704514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.704956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.705242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.705505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.705779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.706051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.706324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.706598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.706867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.707313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.707719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.708228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.709104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.709398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.709658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.709931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.710205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.710479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.710753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.711023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.733860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.735413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.735688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.737411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.739082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.739437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.740985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.741263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.741543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.744705 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.745018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.745301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.748776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.749078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.752544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.752845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.753680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.753966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.754247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.754529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.755331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.755605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.755872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.756131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.758096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.758386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.758672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.758958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.759237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.759514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.759787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.760058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.775495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.775765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.779683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.779966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.780272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.783896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.784183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.784484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.788141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.788433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.789221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.792766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.793398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.796593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.796920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.797104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.797201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.797478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.797761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.798039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.800672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.800995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.801284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.801597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.801881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.802164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.817700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.818157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.818420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.818684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.821818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.822104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.822372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.822648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.826575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.828287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.828563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.830613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.831603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.831887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.832172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.832334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.832458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.832613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.832753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.836366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.836647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.836962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.837262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.837548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.846700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.846976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.847255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.847535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.847812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.848086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.848391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.850981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.851260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.851550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.851831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.852111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.852383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.852657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.867408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.870663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.871204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.873971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.874506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.875553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.877229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.877515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.877797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.877881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.879417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.881883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.882170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.882452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.885920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.887518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.889883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.890742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.891027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.891310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.891502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.891588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.895017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.895334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.895620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.895900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.901171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.901467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.901746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.905125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.905409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.905688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.909613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.909898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.910176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.910450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.910720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.911090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.911295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.911561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.911831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.912103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.912383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.912643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.912942 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.913201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.913708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 13:54:13.913990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.914277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.914559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.914830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.915108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.915403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.915678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.915946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.916223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.916501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.916763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.917157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.917427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 13:54:13.952233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55576695c9c0 pid: 80330 (default app) May 18 13:54:13.955616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08590d06-19e5-4446-bb0f-65848141612c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:13.955911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08590d06-19e5-4446-bb0f-65848141612c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:13.956190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08590d06-19e5-4446-bb0f-65848141612c None None] PATH_INFO: `/v3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:13.956672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55576695c9c0 pid: 80331 (default app) May 18 13:54:13.960955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Wed May 18 13:54:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:23.439055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:23.439631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:23.439817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:23.444661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:54:23.450923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:23.451419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:23.451499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:23.521782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: INFO dbcounter [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] Registered counter for database keystone May 18 13:54:23.548411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG oslo_db.sqlalchemy.engines [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 13:54:23.555858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writer thread running {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 13:54:23.743750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG passlib.handlers.bcrypt [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80330) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 13:54:23.744166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG passlib.handlers.bcrypt [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80330) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 13:54:23.802066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:23.803618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:23.931835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 18 13:54:24.083849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:24.153136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: INFO dbcounter [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] Registered counter for database keystone May 18 13:54:24.173845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG oslo_db.sqlalchemy.engines [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 13:54:24.180795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writer thread running {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 13:54:24.301522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0300-9644-45c6-bc84-53874a33147d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:24.305780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:24.306436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:24.306716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:24.306991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:24.315158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:24.374505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 13:54:24.374770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816558a-d57c-4477-9899-c30a4eceba3c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:24.386200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Wed May 18 13:54:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 13:54:24.392574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:24.407112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec1111-189c-46c9-a3ea-5d97bcd1fe10 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:24.411662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:24.412777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:24.413093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:24.413372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] PATH_INFO: `/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:24.414893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=cac9ce8241ae4db2ae909b6e0401b3f2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:24.578313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 13:54:24.578945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542d18a-56e0-4a54-a6a7-1968bb9888c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:24.583775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Wed May 18 13:54:24 2022] GET /identity/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:26.832209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b179-2053-4d6f-adf2-150c096fc526 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:26.832759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b179-2053-4d6f-adf2-150c096fc526 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:26.832759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b179-2053-4d6f-adf2-150c096fc526 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:26.836904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:26.842441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:26.842830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:26.842993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:26.862099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:26.864154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:26.872013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 18 13:54:26.895661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b179-2053-4d6f-adf2-150c096fc526 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:26.907986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b179-2053-4d6f-adf2-150c096fc526 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:26.912536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01ca7-c17b-4cb1-8fb0-a340262eba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:26.913205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01ca7-c17b-4cb1-8fb0-a340262eba1d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:26.913491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01ca7-c17b-4cb1-8fb0-a340262eba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:26.913770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01ca7-c17b-4cb1-8fb0-a340262eba1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:26.921561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01ca7-c17b-4cb1-8fb0-a340262eba1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:26.923385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01ca7-c17b-4cb1-8fb0-a340262eba1d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:26.932655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Wed May 18 13:54:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 13:54:26.938162 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:26.948216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb613-b31a-4803-a272-883cc7cee863 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:26.952569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02142934-227b-454c-8dc4-1fd19436c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:26.953462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142934-227b-454c-8dc4-1fd19436c2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:26.953740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142934-227b-454c-8dc4-1fd19436c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:26.954007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142934-227b-454c-8dc4-1fd19436c2bd admin admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:26.955514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02142934-227b-454c-8dc4-1fd19436c2bd admin admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:26.957631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02142934-227b-454c-8dc4-1fd19436c2bd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:26.959401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Wed May 18 13:54:26 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:29.291897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aed8b-876d-4901-abab-fd86e70996a2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.292603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aed8b-876d-4901-abab-fd86e70996a2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.292603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7aed8b-876d-4901-abab-fd86e70996a2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.294013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:29.299410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.299847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.300049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.308643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6b63-7d10-402e-95c2-97475e4cc607 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.308973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6b63-7d10-402e-95c2-97475e4cc607 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.309241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6b63-7d10-402e-95c2-97475e4cc607 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.310581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:54:29.318379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.318542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:29.318660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.318918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.319691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:29.358980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80331) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 13:54:29.359387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80331) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 13:54:29.405325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:29.406293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:29.408012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:29.430164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:29.463305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:29.513382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:29.536234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:29.556007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff2907-e6b1-4887-9599-984a9831b81c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:29.593108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:29.593906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.594192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.594471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.607426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:29.618868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:29.619754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:29.620616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:54:29.625864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:29.647147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166018a3-121b-4f62-b452-0fc7975c1c00 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:29.649673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:29.691923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:29.692855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.693145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.693422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.710052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:29.728945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197416c-25b4-40af-9824-8fdbe74ff47f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:29.763941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:29.764521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.764826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.765110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.765871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:29.766176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:29.767849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:29.772110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:29.773663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:29.780352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:29.787379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:29.895013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 8/16] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:54:29.895872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba86d3-b86b-4035-a06b-a19db4c860fa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:29.900502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:29.903384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:29.931909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:29.932834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:29.933098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:29.933446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:29.934600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:29.936064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:29.937723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 9/17] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:29 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:29.943279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:29.958885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:30.001475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e92167-4831-40f9-965d-1286ff700288 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:30.037126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:30.037849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:30.038140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:30.038415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:30.049848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd56f9-950b-4069-a1f8-713f4208b3e4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:30.056978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:30.058457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:54:30.080325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:30.081286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:30.082699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:54:30.082699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:54:30.082699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:54:30.082699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:30.082699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 9/18] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:54:30.086718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:30.087622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:30.087906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:30.088100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:30.088206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:30.089383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:30.090847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:30.092585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 10/19] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:30.098221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:30.157573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:30.192931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:30.205310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d327ba-a8f5-41e7-876f-d780a58e073e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:30.212737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab5480-8c6e-4322-bb30-541e03b3762c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:30.268988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:30.271261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:30.271553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:30.271834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:30.272733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.domain.id=default, user.id=532c808ad3044d808c9b3565bd851ce1) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:30.273076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:30.274623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb9a85-cad1-4e4f-875e-bb64fb936b5c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:30.282853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Wed May 18 13:54:30 2022] GET /identity/v3/role_assignments?user.id=532c808ad3044d808c9b3565bd851ce1&scope.domain.id=default&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 233 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:30.361727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:30.362327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:30.362618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:30.362898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:30.364474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:30.365018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:30.366490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee3e4-58f9-4896-bb8c-ddf1ffd42a8e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:30.387701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:33.081263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710fd8e-f4d3-427e-8182-9cb7302a54f2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.082392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710fd8e-f4d3-427e-8182-9cb7302a54f2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.082392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710fd8e-f4d3-427e-8182-9cb7302a54f2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.084050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:33.089456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efadc2-41c6-433f-aac2-f29301a09397 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.089924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efadc2-41c6-433f-aac2-f29301a09397 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.090023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efadc2-41c6-433f-aac2-f29301a09397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.114072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88efadc2-41c6-433f-aac2-f29301a09397 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:33.115344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88efadc2-41c6-433f-aac2-f29301a09397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:33.212966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:33.248885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710fd8e-f4d3-427e-8182-9cb7302a54f2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:33.379975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080666af-784f-4034-9565-772186abb724 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.380265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080666af-784f-4034-9565-772186abb724 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.380452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080666af-784f-4034-9565-772186abb724 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.381865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:33.388064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d3318-460c-449c-a550-e91a00b10340 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.388354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d3318-460c-449c-a550-e91a00b10340 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.388634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d3318-460c-449c-a550-e91a00b10340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.419538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b07d3318-460c-449c-a550-e91a00b10340 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:33.420816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b07d3318-460c-449c-a550-e91a00b10340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:33.462842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710fd8e-f4d3-427e-8182-9cb7302a54f2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:33.556232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:33.560316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:33.561016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.561295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.561570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.562328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:33.563752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:33.599575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:33.601050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1ea4-89df-4a37-9c52-ca0115c23400 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.601347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1ea4-89df-4a37-9c52-ca0115c23400 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.601634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf1ea4-89df-4a37-9c52-ca0115c23400 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.603351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 14/26] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:33.618156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.618439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.618715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.638379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:33.639532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:33.713913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 15/27] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:33.714787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:33.842026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f959561-514e-433d-b6fd-5eaf8f5eabf6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:33.850093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:33.878536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e2372-5e03-418e-a7a4-1b6baca7e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:33.879384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2372-5e03-418e-a7a4-1b6baca7e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.879775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2372-5e03-418e-a7a4-1b6baca7e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.880060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e2372-5e03-418e-a7a4-1b6baca7e1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.882123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 13/28] 10.222.0.71 () {60 vars in 1131 bytes} [Wed May 18 13:54:33 2022] POST /identity/v3/roles => generated 219 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:33.883254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:33.897290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:33.918697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e2372-5e03-418e-a7a4-1b6baca7e1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-460e2372-5e03-418e-a7a4-1b6baca7e1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:33.935259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:33.936462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:33.937330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:33.947584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 16/29] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:54:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:33.949497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875a2f-fc40-46b3-8ac3-c4d26c157a62 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:33.949939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875a2f-fc40-46b3-8ac3-c4d26c157a62 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:33.950351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875a2f-fc40-46b3-8ac3-c4d26c157a62 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:33.953654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 17/30] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:33.954930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875a2f-fc40-46b3-8ac3-c4d26c157a62 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:34.101952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9124e1-9119-447e-871a-2db0c2471715 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.145257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875a2f-fc40-46b3-8ac3-c4d26c157a62 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.153506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:34.154330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.154618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.154899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.168302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:34.170310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:34.196184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3af570f0-fd71-4203-9b51-239ee72578c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:54:34.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:34.197393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:34.198194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:54:34.198194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:54:34.198194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:54:34.198194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:34.198194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 14/31] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:34.199548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.199838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.200021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.200113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.200573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.201054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.202002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:34.202493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:34.204207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:34.221490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 18/32] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:34.223581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:34.228656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:34.230322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:34.273730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:34.318856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:34.341750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 15/33] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:34.349246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:34.390402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c2508-124a-4f4d-a341-636a5097fde3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.442302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:34.443430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.443994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.444446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.445650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:34.447024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:34.448619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:34.470178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 19/34] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:34.470178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:34.491960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633635e-dbda-4258-ab0a-e8fd556ca337 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.540019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:34.541769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.542526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.543019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.544460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:34.546850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:34.549574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 16/35] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:34 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:34.551446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:34.572233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:34.587890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe71b98-6a16-4a93-b9c7-c23747efe495 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.617921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:34.623539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2beaa8-005e-43f9-867d-1392ebe800c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:34.624218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2beaa8-005e-43f9-867d-1392ebe800c4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.624504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2beaa8-005e-43f9-867d-1392ebe800c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.624802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2beaa8-005e-43f9-867d-1392ebe800c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.625691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2beaa8-005e-43f9-867d-1392ebe800c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:34.627092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2beaa8-005e-43f9-867d-1392ebe800c4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:34.667407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e4633-170a-4645-ba8e-724026b4ba67 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.702395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:34.702990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.703276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.703558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.704321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:34.705832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:34.819522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 17/36] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:54:34 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:34.820705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:34.856738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 20/37] 10.222.0.71 () {60 vars in 1131 bytes} [Wed May 18 13:54:34 2022] POST /identity/v3/roles => generated 225 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:34.862833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d11bae-cc94-42bd-a5bc-f02b7b0a69ae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.863846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d11bae-cc94-42bd-a5bc-f02b7b0a69ae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.864668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d11bae-cc94-42bd-a5bc-f02b7b0a69ae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.866150 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 21/38] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:34.876835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d039ce-0fb3-4c46-b6b4-aff3318698f5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:34.876835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d039ce-0fb3-4c46-b6b4-aff3318698f5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:34.876835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d039ce-0fb3-4c46-b6b4-aff3318698f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:34.917372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83d039ce-0fb3-4c46-b6b4-aff3318698f5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:34.918956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83d039ce-0fb3-4c46-b6b4-aff3318698f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:34.973289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68fb92-975a-4b28-bd79-b87fade1775e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:34.984023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:35.027723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:35.028746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.029062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.029353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.029789 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 22/39] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:35.031572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45551afb-f058-44e0-a815-af7fcee1f382 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.031868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45551afb-f058-44e0-a815-af7fcee1f382 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.032191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45551afb-f058-44e0-a815-af7fcee1f382 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.037901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:35.038548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 23/40] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:35.040010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:35.040521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.040875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.041170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.041847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 18/41] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:35.048001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:35.068983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:35.070637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:35.156460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 24/42] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:35.157473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:35.170617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:35.198514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23644-1f8e-4815-b3b7-048cfe7f115c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:35.240182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:35.241175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.241461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.241755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] PATH_INFO: `/v3/domains/default/users/532c808ad3044d808c9b3565bd851ce1/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.243789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=532c808ad3044d808c9b3565bd851ce1, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:35.245477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:35.264573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34faae-8a19-46bf-9575-1b87999deb62 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:35.299393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:35.300065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.300551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.300999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.301721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:35.303245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:35.337197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 19/43] 10.222.0.71 () {58 vars in 1361 bytes} [Wed May 18 13:54:35 2022] PUT /identity/v3/domains/default/users/532c808ad3044d808c9b3565bd851ce1/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:54:35.338030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:35.377248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:35.389780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 25/44] 10.222.0.71 () {60 vars in 1131 bytes} [Wed May 18 13:54:35 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:35.461589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2262720-82b1-4845-8c8b-4a8f5eed3839 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:35.503349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2d534-4a57-44e4-a187-a06911bedb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:35.504886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2d534-4a57-44e4-a187-a06911bedb0a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.505379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2d534-4a57-44e4-a187-a06911bedb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.505669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2d534-4a57-44e4-a187-a06911bedb0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.507107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2d534-4a57-44e4-a187-a06911bedb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:35.508644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2d534-4a57-44e4-a187-a06911bedb0a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:35.510648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 20/45] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:35.516420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:35.602610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:35.654628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8546a-68de-4a68-83dd-be91d31bb082 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:35.691793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41a64b-a6d1-4c3f-bdde-a7f81eb4dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:35.692466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41a64b-a6d1-4c3f-bdde-a7f81eb4dcc7 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:35.692753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41a64b-a6d1-4c3f-bdde-a7f81eb4dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:35.693063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41a64b-a6d1-4c3f-bdde-a7f81eb4dcc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:35.694035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41a64b-a6d1-4c3f-bdde-a7f81eb4dcc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:35.695510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41a64b-a6d1-4c3f-bdde-a7f81eb4dcc7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:35.781553 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 26/46] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:54:35 2022] POST /identity/v3/projects => generated 312 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:37.659630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7e561-c627-4562-b17d-a4831a02ff08 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:37.660210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7e561-c627-4562-b17d-a4831a02ff08 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:37.660504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7e561-c627-4562-b17d-a4831a02ff08 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:37.662535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 21/47] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:37.667798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:37.668220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:37.668484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:37.685958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:37.687150 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:37.755210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 27/48] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:37.779384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7e561-c627-4562-b17d-a4831a02ff08 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:37.890531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7e561-c627-4562-b17d-a4831a02ff08 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:37.892664 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:37.929630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96993f66-89a2-4bb4-b7b9-2adf05c1a275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:37.930368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96993f66-89a2-4bb4-b7b9-2adf05c1a275 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:37.930850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96993f66-89a2-4bb4-b7b9-2adf05c1a275 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:37.931297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96993f66-89a2-4bb4-b7b9-2adf05c1a275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:37.942516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96993f66-89a2-4bb4-b7b9-2adf05c1a275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-96993f66-89a2-4bb4-b7b9-2adf05c1a275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:37.950262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:37.951095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:37.951858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 22/49] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:54:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:37.957308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:38.007106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:38.059852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5dafa-395e-4173-ac11-027e6c295ddb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:38.085287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c85bf-5028-4ec2-bb62-753b63079fe2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.085631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c85bf-5028-4ec2-bb62-753b63079fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.085850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c85bf-5028-4ec2-bb62-753b63079fe2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.087226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 23/50] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:54:38.092316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.092598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.092908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.096006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:38.096681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.097015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.097541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.098232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:38.098551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:38.100041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:38.108584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 28/51] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:38.110531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:38.111803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:38.114535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:38.185116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 24/52] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:38.209490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:38.217763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbbdc6-eb95-4ca2-b87c-088b8a060810 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:38.234892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:38.256422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:38.257337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.257624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.257904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.259499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:38.260998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:38.262657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 29/53] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:38 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:38.268171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:38.306496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:38.314979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb7374-ae89-4102-947e-365379dd17f5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:38.349288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:38.350081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.350369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.350649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.351831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:38.353365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:38.355001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 25/54] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:38.360373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:38.370917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24b8e-86ea-46ea-bdef-33ceef792f9c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:38.406288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:38.407095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.407381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.407659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.408981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:38.410963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:38.412596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 30/55] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:38.418406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:38.461507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f76e-6bb5-4161-9416-d55c260ba772 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:38.469464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:38.495955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3162e5-56a9-4253-ae85-4ac6ee68d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:38.496713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3162e5-56a9-4253-ae85-4ac6ee68d2ab None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.497027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3162e5-56a9-4253-ae85-4ac6ee68d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.497311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3162e5-56a9-4253-ae85-4ac6ee68d2ab None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.498019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3162e5-56a9-4253-ae85-4ac6ee68d2ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:38.499502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3162e5-56a9-4253-ae85-4ac6ee68d2ab None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:38.521833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ded8f-af7b-4e2b-bb09-5e657c6933e1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:38.555650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:38.556312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:38.556615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:38.556910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:38.557746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.domain.id=default, user.id=532c808ad3044d808c9b3565bd851ce1) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:38.558060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:38.559494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2b743-d65f-44fd-91ce-b1ccdaa0fe0b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:38.568639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 31/56] 10.222.0.71 () {56 vars in 1322 bytes} [Wed May 18 13:54:38 2022] GET /identity/v3/role_assignments?user.id=532c808ad3044d808c9b3565bd851ce1&scope.domain.id=default&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:38.581286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 26/57] 10.222.0.71 () {60 vars in 1140 bytes} [Wed May 18 13:54:38 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:54:40.837217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91fbf3-bf91-43cf-ae05-2095b3b80bde None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:40.837735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91fbf3-bf91-43cf-ae05-2095b3b80bde None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:40.837818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91fbf3-bf91-43cf-ae05-2095b3b80bde None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:40.839148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 32/58] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:40.844260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:40.844651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:40.844860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:40.861317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:40.862494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:40.870365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:40.929669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 27/59] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:40.954659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91fbf3-bf91-43cf-ae05-2095b3b80bde None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:41.056077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91fbf3-bf91-43cf-ae05-2095b3b80bde None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:41.069227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:41.089121 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d2c6f-171c-4a61-87a9-d640f14db3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:41.089848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d2c6f-171c-4a61-87a9-d640f14db3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:41.090135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d2c6f-171c-4a61-87a9-d640f14db3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:41.090414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d2c6f-171c-4a61-87a9-d640f14db3e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:41.091576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d2c6f-171c-4a61-87a9-d640f14db3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:41.093036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d2c6f-171c-4a61-87a9-d640f14db3e7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:41.094654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 33/60] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:41.100960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:41.200605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de51b49-e187-4be1-a48a-62414add70a1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:41.236165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea7bc6-ebc3-48e3-ae3e-40a182861872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:41.236970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7bc6-ebc3-48e3-ae3e-40a182861872 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:41.237159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7bc6-ebc3-48e3-ae3e-40a182861872 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:41.237441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea7bc6-ebc3-48e3-ae3e-40a182861872 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:41.239123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea7bc6-ebc3-48e3-ae3e-40a182861872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:41.240715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea7bc6-ebc3-48e3-ae3e-40a182861872 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:41.427205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:41.432711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 28/61] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:54:41 2022] POST /identity/v3/users => generated 275 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:44.827215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12f59-17aa-4c01-9a20-5d546e0c3a3b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:44.828206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12f59-17aa-4c01-9a20-5d546e0c3a3b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:44.828688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12f59-17aa-4c01-9a20-5d546e0c3a3b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:44.830561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 34/62] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:44.837065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:44.837560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:44.837641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:44.862165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:44.863703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:44.922228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb84f-4dd4-4918-9873-e9262bd4004b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:44.922912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb84f-4dd4-4918-9873-e9262bd4004b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:44.923364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb84f-4dd4-4918-9873-e9262bd4004b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:44.926454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 35/63] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:44.931588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:44.932151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:44.932645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:44.947498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 29/64] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:44.964829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:44.966065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:44.971408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.078051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 36/65] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:45.105624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.150951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfec73-b7c3-47b4-9978-dd21547e430c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.179251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:45.188623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.189919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.190979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.191534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.205244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:45.214584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:45.215581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:45.216378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:45.218878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 30/66] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:54:45.229897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.263492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c65d2-c786-4a44-bb6d-ef7dcc928c7e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.284633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:45.344263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.345027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.345318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.345599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.377805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:45.394643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:45.395623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:45.396394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 37/67] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:45.401646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.406516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a068a-a737-4263-9fed-fa87d2ce341a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.442430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.443106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.443391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.443667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.444425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:45.444733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:45.446174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beb7b1-d2aa-467a-8bac-63f12f6e8c0d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:45.455061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 31/68] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:45.456338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961fc1-67e7-4e0c-8978-c745bf800365 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.456693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961fc1-67e7-4e0c-8978-c745bf800365 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.457001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961fc1-67e7-4e0c-8978-c745bf800365 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.462431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 32/69] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:45.462431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a96f-5975-4a4e-9d4a-5407701f647c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.462431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a96f-5975-4a4e-9d4a-5407701f647c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.462431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a96f-5975-4a4e-9d4a-5407701f647c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.462431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 33/70] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:45.462431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3a96f-5975-4a4e-9d4a-5407701f647c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.520041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:45.526311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0112e-80de-4fd6-8610-1783ff3b4fca None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.560604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.561301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.561588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.561862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.562602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:45.562906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:45.564285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5cbfd-7407-4892-8d41-57a7ea9bc47b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:45.571766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3a96f-5975-4a4e-9d4a-5407701f647c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.573695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 38/71] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:45.575030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcd263-cb9f-4d9f-b993-09925f6ac01e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.575324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcd263-cb9f-4d9f-b993-09925f6ac01e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.575602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcd263-cb9f-4d9f-b993-09925f6ac01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.593640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b0dcd263-cb9f-4d9f-b993-09925f6ac01e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:45.594945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b0dcd263-cb9f-4d9f-b993-09925f6ac01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:45.615341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e1fc4-928c-409a-9098-1e21c8690069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.616225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e1fc4-928c-409a-9098-1e21c8690069 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.616512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e1fc4-928c-409a-9098-1e21c8690069 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.616854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e1fc4-928c-409a-9098-1e21c8690069 None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.624643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:45.631588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e1fc4-928c-409a-9098-1e21c8690069 None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:45.633109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e1fc4-928c-409a-9098-1e21c8690069 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:45.634846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 34/72] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:45.639052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.639052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.639052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.656078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:45.657331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:45.668298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 39/73] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:45.669499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a53e0-d044-4e50-bb5f-cbc95b02f514 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.669797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a53e0-d044-4e50-bb5f-cbc95b02f514 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.670075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a53e0-d044-4e50-bb5f-cbc95b02f514 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.671367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 40/74] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:45.672078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a53e0-d044-4e50-bb5f-cbc95b02f514 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.742669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 35/75] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:45.743881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.790292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:45.793429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a53e0-d044-4e50-bb5f-cbc95b02f514 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.829440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6931e-8521-4170-a4b7-85730be82ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.830312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6931e-8521-4170-a4b7-85730be82ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.830590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6931e-8521-4170-a4b7-85730be82ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.830859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6931e-8521-4170-a4b7-85730be82ef8 None admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.832660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6931e-8521-4170-a4b7-85730be82ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:45.834301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6931e-8521-4170-a4b7-85730be82ef8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:45.836042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 41/76] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:45.837311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.837596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.837869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.852878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75603793-e430-49b3-a9fa-41b339e6a065 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:45.856017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:45.857240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:45.882410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:45.888411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:45.894062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:45.894062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:45.894062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:45.928102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 42/77] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:45.929046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:45.975045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:45.976596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.018554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.036743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1409e-054c-4611-9018-b4e93c41734b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.072501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.073345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.073634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.073911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.080078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 36/78] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:54:46.080967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.086038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:46.094124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:46.095181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:46.096027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 43/79] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:54:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:46.096710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.120235 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.185469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d58795-7066-413f-99f6-71ef9bf9e09d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.205726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d1c5e-8f86-4089-a0ed-fabf8f5fc77d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.220662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.221484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.222344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.223209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.224380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.225867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.227512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 37/80] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:46.230773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.239780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.247415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.248078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.248512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.253310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.324475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.326001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.332047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f683-2494-488f-87a6-a7d8586deb9e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.349241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.365882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.366674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.366958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.367234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.377427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:46.385123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:46.386065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 38/81] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:46.387312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.432634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 44/82] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:54:46.433332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.459542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.494752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837beb6e-cfeb-44b1-9967-687f8146ceac None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.530489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.531351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.531639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.531917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.533205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.534747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.536171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8adb-c408-42af-b694-b1a3873d97b9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.536476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 39/83] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:46.537280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.561250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.577221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.578330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.578621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.578901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.579643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:46.580314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.582713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.591605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 45/84] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:46.591605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.643121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706d8e-6123-4290-98cb-50e97c8236dd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.682781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.683462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.683745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.684082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.684732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.686320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.693084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.699587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaaa36-99a9-446f-a008-dc91a5ae2dd8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.734728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.735439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.735773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.736002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.736748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:46.737088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.739651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.747781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 46/85] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:46.749361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.776591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 40/86] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:54:46 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:46.777482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.797601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:46.862482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57e65-1ca8-4268-bd52-3b56adf37638 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.903543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.904478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.904809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.905097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.906399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.907860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.910473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 47/87] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:46.911197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:46.919599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99b18c-7281-49ae-8e2e-3c6cdd19b00f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:46.961033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:46.961725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:46.962374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:46.962660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:46.963847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=5ddcc524dfeb40e8a8372a7177400fb4) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:46.964148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:46.965946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:46.973512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 41/88] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/role_assignments?user.id=5ddcc524dfeb40e8a8372a7177400fb4&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:46.973952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:47.048924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b7f0-c23c-4bcf-82de-4a29db2e5695 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:47.071202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:47.083757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:47.116733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:47.118585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:47.119085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:47.119528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:47.121718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:47.125589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:47.128460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 48/89] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:47.129009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:47.158101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481519f7-534d-4ab2-93aa-4e8ac72f0d3a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:47.213769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:47.214724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:47.215014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:47.215345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:47.217599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:47.219106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:47.221221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 42/90] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:46 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:47.222767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:47.327223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fed22-cd50-4e7b-9603-3acf50f5a17c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:47.379666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:47.380365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:47.380656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:47.380970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:47.381839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=532c808ad3044d808c9b3565bd851ce1) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:47.382157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:47.383692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:47.402418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 49/91] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:54:47 2022] GET /identity/v3/role_assignments?user.id=532c808ad3044d808c9b3565bd851ce1&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:47.403327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:47.487554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7f625-5389-4c21-9355-8bd90f32cddb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:47.513459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:47.537319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:47.560166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:47.560919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:47.561450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:47.561932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:47.634263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88239f-b4ca-44be-a7c4-38559faeec2b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:47.709635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:47.711472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:47.711760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:47.712043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:47.714054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:47.715590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:47.865815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:47.867296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:47.920954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 43/92] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:54:47.930307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:47.960221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:47.982409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:48.069282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 50/93] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:54:48.076229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:48.135438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c47ca-1a4e-4e68-ba0b-5e3e05b471ee None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:48.186076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:48.186960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:48.187248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:48.187527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:48.191525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:48.193266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:48.195195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 44/94] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:47 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:48.201272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:48.326941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107db4-3718-4a53-98f3-87cacf38cf32 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:48.377160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:48.399815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201af39e-7db4-4414-8299-9bb31741d9f3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:48.421514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:48.422409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:48.422698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:48.422979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] PATH_INFO: `/v3/projects/1448cc56f11440c1a8ea9620001f9ed3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:48.424245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] RBAC: Authorizing `identity:get_project(project_id=1448cc56f11440c1a8ea9620001f9ed3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:48.426031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:48.428084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 51/95] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:48 2022] GET /identity/v3/projects/1448cc56f11440c1a8ea9620001f9ed3 => generated 312 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:48.437015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:48.463646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:48.464672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:48.465176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:48.465792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:48.466841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] RBAC: Adding query filter params (role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=5ddcc524dfeb40e8a8372a7177400fb4) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:48.467376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:48.469247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86edc0-2e9c-4ace-962f-b7d7cdd53543 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:48.474991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:48.481259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 45/96] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:54:48 2022] GET /identity/v3/role_assignments?user.id=5ddcc524dfeb40e8a8372a7177400fb4&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:48.656204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6de05-a5d3-452d-99c8-8db1fef1685a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:48.707902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:48.708584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:48.708899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:48.709183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:48.710142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=1448cc56f11440c1a8ea9620001f9ed3, user.id=5ddcc524dfeb40e8a8372a7177400fb4) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:48.710473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:48.711938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f3b9e-e7f3-4816-8238-6ca6358fc864 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:48.721449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 52/97] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:54:48 2022] GET /identity/v3/role_assignments?user.id=5ddcc524dfeb40e8a8372a7177400fb4&scope.project.id=1448cc56f11440c1a8ea9620001f9ed3&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:49.991023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f777f-5ee5-43e4-b785-20e2e5a9728f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:49.991833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f777f-5ee5-43e4-b785-20e2e5a9728f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:49.991833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f777f-5ee5-43e4-b785-20e2e5a9728f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:49.993381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 46/98] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:50.000125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bea6d-3b01-4612-b4e7-2f79a5f555d0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.000638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bea6d-3b01-4612-b4e7-2f79a5f555d0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.000712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bea6d-3b01-4612-b4e7-2f79a5f555d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.023858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-228bea6d-3b01-4612-b4e7-2f79a5f555d0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:50.025111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-228bea6d-3b01-4612-b4e7-2f79a5f555d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:50.126551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 53/99] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:50.150298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fc68-fb12-4dee-a397-432b1cab578b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.150590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fc68-fb12-4dee-a397-432b1cab578b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.150862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7fc68-fb12-4dee-a397-432b1cab578b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.152249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 47/100] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:50.157932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0ba5-6223-4ed7-afab-a10ffb8a1c87 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.158226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0ba5-6223-4ed7-afab-a10ffb8a1c87 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.158511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0ba5-6223-4ed7-afab-a10ffb8a1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.169867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fc68-fb12-4dee-a397-432b1cab578b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:50.173010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:50.185222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ec0a0ba5-6223-4ed7-afab-a10ffb8a1c87 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:50.186495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ec0a0ba5-6223-4ed7-afab-a10ffb8a1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:50.305640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7fc68-fb12-4dee-a397-432b1cab578b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:50.330702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 54/101] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:50.340069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa702-ea65-4825-9138-901d0a8ec91d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.340455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa702-ea65-4825-9138-901d0a8ec91d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.340678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa702-ea65-4825-9138-901d0a8ec91d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.342231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 55/102] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:50.348287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.348581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.348884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.378323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:50.379734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:50.393592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:50.394761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.395053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.395339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.429956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:50.441962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:50.442939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:50.443721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 48/103] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:54:50.444406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:50.465200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 56/104] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:50.466376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:50.490386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:50.581659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:50.650747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c11c-78db-41c7-a8fd-12a760af8611 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:50.662833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4624b-7f9e-4ba8-ad8a-90bd7d319a67 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:50.716412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:50.717354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.717642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.718623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.732278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:50.735022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:50.735768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.736063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.736346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.737241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:50.737558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:50.738949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:50.740824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:50.741689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:50.742455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 49/105] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:50.743633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:50.758623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 57/106] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:50.759894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:50.883506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c62b9-190e-409b-a41d-efefb95e7807 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:50.915614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:50.926441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958b00-7339-4951-be40-8315fda31216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:50.932222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958b00-7339-4951-be40-8315fda31216 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:50.932222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958b00-7339-4951-be40-8315fda31216 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:50.932222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958b00-7339-4951-be40-8315fda31216 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:50.932222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de958b00-7339-4951-be40-8315fda31216 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:50.932539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:50.932612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de958b00-7339-4951-be40-8315fda31216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:50.932965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de958b00-7339-4951-be40-8315fda31216 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:50.945836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 58/107] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:50.947656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958b00-7339-4951-be40-8315fda31216 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:50.957582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98d1c7-e7d1-4c0e-bae0-4bd534e32022 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:50.999306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a59f4-1771-4cce-aeaa-efae845b554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.000179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a59f4-1771-4cce-aeaa-efae845b554e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.000497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a59f4-1771-4cce-aeaa-efae845b554e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.000777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a59f4-1771-4cce-aeaa-efae845b554e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.002285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a59f4-1771-4cce-aeaa-efae845b554e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:51.005084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a59f4-1771-4cce-aeaa-efae845b554e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:51.007269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 50/108] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:51.008620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619ab4a-4392-43a2-9a0b-39814186b45f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619ab4a-4392-43a2-9a0b-39814186b45f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.009229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619ab4a-4392-43a2-9a0b-39814186b45f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.011336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 51/109] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:51.012488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619ab4a-4392-43a2-9a0b-39814186b45f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.093254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958b00-7339-4951-be40-8315fda31216 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:51.133753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.134565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.135117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.135117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] PATH_INFO: `/v3/users/151b1969fa6f4226a95c8e0b941835b6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.153096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] RBAC: Authorizing `identity:get_user(user_id=151b1969fa6f4226a95c8e0b941835b6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:51.154768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:51.156675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 59/110] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:50 2022] GET /identity/v3/users/151b1969fa6f4226a95c8e0b941835b6 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:51.160639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619ab4a-4392-43a2-9a0b-39814186b45f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:51.161599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.198758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e804f64-0783-41e8-913f-b53e3ca08bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.199795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e804f64-0783-41e8-913f-b53e3ca08bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.200064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e804f64-0783-41e8-913f-b53e3ca08bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.200384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e804f64-0783-41e8-913f-b53e3ca08bd1 None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.201747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e804f64-0783-41e8-913f-b53e3ca08bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:51.203411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e804f64-0783-41e8-913f-b53e3ca08bd1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:51.205870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 52/111] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:51 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:51.207845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.208133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.208447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.228054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:51.237176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:51.238766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:51.243319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:51.300639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3d17c-6a9b-4adc-89d4-4b51ef02bc22 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:51.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 53/112] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:51.315083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.349338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.350014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.350298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.351604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.352137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:51.353687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:51.433671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b462458-6fc3-4cec-a585-bc4a793026fd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:51.447831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 60/113] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:54:51 2022] POST /identity/v3/projects => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:54:51.449204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.477310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.478088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.478387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.478671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.493219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:51.591196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:51.596415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786c30b-6a85-449a-ac68-512af59a1541 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:51.645044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.646661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.647192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.647742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.649660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:51.653540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:51.657361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 61/114] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:51 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:51.658886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.692536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:51.694393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:51.810911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda202e8-505c-4723-9cab-d4ae5b469c27 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:51.853105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 54/115] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:54:51.854063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.856749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb243223-b9f1-4f79-938b-80fd86c2e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:51.857911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243223-b9f1-4f79-938b-80fd86c2e81a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.858395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243223-b9f1-4f79-938b-80fd86c2e81a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.858884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243223-b9f1-4f79-938b-80fd86c2e81a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.872263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb243223-b9f1-4f79-938b-80fd86c2e81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fb243223-b9f1-4f79-938b-80fd86c2e81a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:51.881504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:51.882405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:51.883209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:51.885769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 62/116] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:54:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:51.887716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d7fc-5b21-4607-986e-8421740aeb10 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:51.888399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d7fc-5b21-4607-986e-8421740aeb10 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:51.888999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8d7fc-5b21-4607-986e-8421740aeb10 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:51.890616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 63/117] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:51.891854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8d7fc-5b21-4607-986e-8421740aeb10 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:51.908329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:51.927730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:51.991617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385f099-f39d-4baf-bc2d-cc5423f1ddf0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:52.017226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8d7fc-5b21-4607-986e-8421740aeb10 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:52.036697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4bfdb-0342-4290-9180-8c885111509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:52.037626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4bfdb-0342-4290-9180-8c885111509a None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.037914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4bfdb-0342-4290-9180-8c885111509a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.038192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4bfdb-0342-4290-9180-8c885111509a None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/5ddcc524dfeb40e8a8372a7177400fb4/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.040500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4bfdb-0342-4290-9180-8c885111509a None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3cbbf04054e2fb4f841d3f285788d, user_id=5ddcc524dfeb40e8a8372a7177400fb4, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:52.042109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4bfdb-0342-4290-9180-8c885111509a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:52.061651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:52.063343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.063343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.063343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.064460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:52.066570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:52.074777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 64/118] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:51 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:52.074777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:52.106362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 55/119] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:54:51 2022] PUT /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/5ddcc524dfeb40e8a8372a7177400fb4/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:54:52.118435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.118725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.119027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.157579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:52.160322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:52.241694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:52.248695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28785d51-cea4-4177-af09-932a2e3a87ae None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:52.291513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0420a-621b-47db-940f-97312288087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:52.292208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0420a-621b-47db-940f-97312288087d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.292494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0420a-621b-47db-940f-97312288087d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.292774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0420a-621b-47db-940f-97312288087d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.293584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0420a-621b-47db-940f-97312288087d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:52.293999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0420a-621b-47db-940f-97312288087d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:52.295340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0420a-621b-47db-940f-97312288087d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:52.308807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 65/120] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:52.308807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23b11d-87ee-4d00-ae12-410493af0568 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.309065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23b11d-87ee-4d00-ae12-410493af0568 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.309236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23b11d-87ee-4d00-ae12-410493af0568 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.309455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 56/121] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:52.310545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:52.310652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 66/122] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:52.312943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23b11d-87ee-4d00-ae12-410493af0568 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:52.367927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:52.480166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23b11d-87ee-4d00-ae12-410493af0568 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:52.492616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127e9b3-7a43-4d7d-9971-f19a3b9da3e0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:52.541328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:52.542351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.542850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.543315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.544328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:52.544665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] RBAC: Adding query filter params (role.id=992ff3ff2e974a7ca11155a41f5ac10a, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=151b1969fa6f4226a95c8e0b941835b6) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:52.545186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:52.545934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.546449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.546952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.547476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b3b3b-9f6d-4d74-a946-27de3ee15d9f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:52.549326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:52.552802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:52.555714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 57/123] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:54:52 2022] GET /identity/v3/role_assignments?user.id=151b1969fa6f4226a95c8e0b941835b6&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=992ff3ff2e974a7ca11155a41f5ac10a => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:52.556354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 67/124] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:52 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:52.557826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.558009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:52.558498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.558968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.603689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:52.607105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:52.631520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:52.788325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728ea94-6a4d-4e9c-966d-809e8c15fa09 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:52.789519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 58/125] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:52.790515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:52.842040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:52.848670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:52.849572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:52.849965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:52.850318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:52.863125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:52.871610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:52.872591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:52.873379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 68/126] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:54:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:52.874019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:52.974826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:52.991876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d927c-f480-4bc7-b17a-8934bbc1eb9a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.033147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.034552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.034893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.035360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.048309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:53.056615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:53.057587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:53.058352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 69/127] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:53.059464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.062847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e3323-9f3d-430c-9de6-d4f471f60833 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.181565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.186596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.186596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.186596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.187721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a145b5-c7a8-4e08-b466-05d0ef034d56 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.189676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:53.191570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:53.193660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 59/128] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:52 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:53.194304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.228062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.228750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.229055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.229335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.230117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:53.232627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:53.234107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:53.243979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 70/129] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:54:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:53.244714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.257459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:53.360570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddffcbc-1559-4673-b95a-7b3865f51639 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.398200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.399538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.400012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.400500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/532c808ad3044d808c9b3565bd851ce1/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.402777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3cbbf04054e2fb4f841d3f285788d, user_id=532c808ad3044d808c9b3565bd851ce1, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:53.404447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:53.433557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:53.444006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607a3c-5683-48d2-9bd0-f7992ff5086d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.494803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.495526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.495917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.496204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.497087 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:53.497400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:53.498877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:53.509921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 60/130] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:53.510797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.514799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 71/131] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:54:53 2022] PUT /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/532c808ad3044d808c9b3565bd851ce1/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:54:53.525922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.652304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb362d-ffb0-411d-84b5-33023a3571d0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.699004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.700229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.700672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.701156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.703037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:53.704873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:53.708470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 61/132] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:53 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:53.715331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.717479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:53.783055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:53.810190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766cb1a-6c24-47c2-93e0-cfe79a5f2627 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:53.911720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:53.913389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:53.913689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:53.913942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:53.916695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:53.918218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:53.919948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 72/133] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:53 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:53.925714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:53.966445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ea490-fcc7-4790-92bc-b3c39713a66d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:54.048166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:54.049089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:54.049386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:54.050371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:54.054898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:54.056413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:54.061904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 62/134] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:53 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:54.068644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:54.118798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79363d-7eac-4b84-9de3-f3d3b572068e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:54.156488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:54.157393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:54.157680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:54.157957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] PATH_INFO: `/v3/projects/1448cc56f11440c1a8ea9620001f9ed3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:54.159253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] RBAC: Authorizing `identity:get_project(project_id=1448cc56f11440c1a8ea9620001f9ed3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:54.160744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:54.162695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 73/135] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:53 2022] GET /identity/v3/projects/1448cc56f11440c1a8ea9620001f9ed3 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:54.168483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:54.173164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:54.237421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:54.270288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e69602-142d-405a-9cd7-10e41d20d4c6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:54.284431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a472bb0-7743-4acf-abfc-1487367ad288 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:54.341246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d23273-cbd6-4441-8a8c-7466f85c2eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:54.342382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d23273-cbd6-4441-8a8c-7466f85c2eef None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:54.342847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d23273-cbd6-4441-8a8c-7466f85c2eef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:54.343331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d23273-cbd6-4441-8a8c-7466f85c2eef None admin] PATH_INFO: `/v3/projects/1448cc56f11440c1a8ea9620001f9ed3/users/5ddcc524dfeb40e8a8372a7177400fb4/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:54.351365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d23273-cbd6-4441-8a8c-7466f85c2eef None admin] RBAC: Authorizing `identity:create_grant(project_id=1448cc56f11440c1a8ea9620001f9ed3, user_id=5ddcc524dfeb40e8a8372a7177400fb4, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:54.354677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d23273-cbd6-4441-8a8c-7466f85c2eef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:54.360597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651be5a-fd53-412d-9772-ffa9df655091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:54.363444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651be5a-fd53-412d-9772-ffa9df655091 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:54.364030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651be5a-fd53-412d-9772-ffa9df655091 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:54.364586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651be5a-fd53-412d-9772-ffa9df655091 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/5ddcc524dfeb40e8a8372a7177400fb4/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:54.370785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651be5a-fd53-412d-9772-ffa9df655091 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3cbbf04054e2fb4f841d3f285788d, user_id=5ddcc524dfeb40e8a8372a7177400fb4, role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:54.373518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651be5a-fd53-412d-9772-ffa9df655091 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:54.478506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 74/136] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:54:54 2022] PUT /identity/v3/projects/1448cc56f11440c1a8ea9620001f9ed3/users/5ddcc524dfeb40e8a8372a7177400fb4/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:54:54.530650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 63/137] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:54:54 2022] PUT /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/5ddcc524dfeb40e8a8372a7177400fb4/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:54:54.761583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956868d-19ba-44ba-867a-ea92f7decbaf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:54.761956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956868d-19ba-44ba-867a-ea92f7decbaf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:54.762428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956868d-19ba-44ba-867a-ea92f7decbaf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:54.765242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 75/138] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:54.784285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:54.784812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:54.785291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:54.829257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:54.830627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:54.930187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 64/139] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:54.972408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956868d-19ba-44ba-867a-ea92f7decbaf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:55.054125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:55.104940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956868d-19ba-44ba-867a-ea92f7decbaf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:55.151723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039cb99-3d26-4576-842d-6b4aec4810be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:55.152554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039cb99-3d26-4576-842d-6b4aec4810be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:55.152862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039cb99-3d26-4576-842d-6b4aec4810be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:55.153139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039cb99-3d26-4576-842d-6b4aec4810be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:55.154482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039cb99-3d26-4576-842d-6b4aec4810be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:55.155964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039cb99-3d26-4576-842d-6b4aec4810be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:55.157717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 76/140] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:54:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:55.165852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:55.331474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:55.377277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ad882-8e96-4dcb-8c7a-4d1ed0bf634d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:55.442891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be049f-2eac-4e1f-996b-456236129f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:55.444064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be049f-2eac-4e1f-996b-456236129f7e None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:55.444565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be049f-2eac-4e1f-996b-456236129f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:55.445109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be049f-2eac-4e1f-996b-456236129f7e None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:55.446468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be049f-2eac-4e1f-996b-456236129f7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:55.449248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be049f-2eac-4e1f-996b-456236129f7e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:55.566074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 65/141] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:54:55 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:54:55.603259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87dd6f-ebe5-41ba-9259-ca7f794bdd7d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:55.604407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87dd6f-ebe5-41ba-9259-ca7f794bdd7d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:55.604936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87dd6f-ebe5-41ba-9259-ca7f794bdd7d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:55.606660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 77/142] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:55.616711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:55.617309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:55.617808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:55.631411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e91c-6992-4506-a997-298a005ce339 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:55.631740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e91c-6992-4506-a997-298a005ce339 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:55.631967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e91c-6992-4506-a997-298a005ce339 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:55.633522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 78/143] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:55.639819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:55.640375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:55.640893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:55.660006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:55.660639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:55.662074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:55.662240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:55.771758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 79/144] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:55.785583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 66/145] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:55.854749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:55.874764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:56.017183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:56.078662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adeb282-09ed-4a78-917f-d0a642a8af2c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:56.087543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:56.127426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:56.128218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:56.128504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:56.128779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:56.140511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:56.149459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:56.150588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:56.151579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:56.153764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 80/146] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:56.163378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:56.214723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f81d8-1df5-4416-9867-6ed07ebd1471 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:56.350120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:56.351486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:56.351986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:56.352483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:56.403053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:56.426568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:56.427679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:54:56.428751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:56.429464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 67/147] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 555 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:54:56.449133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:56.477170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174cfad-a51b-49eb-9ee1-f81c2b03df45 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:56.509638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:56.531662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:56.532367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:56.532657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:56.532980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:56.534166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:56.534488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:56.537582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:56.545985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 81/148] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:56.566562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:56.658102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb421a7-c738-4006-848f-b9d706de566e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:56.691684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:56.702721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:56.703650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:56.704164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:56.704688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:56.706371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:56.706862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:56.708479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:56.716899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7424c-b712-4d39-8040-cac75fba2b1d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:56.719949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 68/149] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:56.735659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:56.797494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:56.801719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:56.802205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:56.802645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:56.805884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:56.809691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:56.818394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 82/150] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:56 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:56.826079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:56.935098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f6bd4-1a4b-4c0e-a21a-d6b790b49bcf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:56.984507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:57.011807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:57.013640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:57.014256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:57.015975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] PATH_INFO: `/v3/users/151b1969fa6f4226a95c8e0b941835b6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:57.020051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] RBAC: Authorizing `identity:get_user(user_id=151b1969fa6f4226a95c8e0b941835b6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:57.021755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:57.029522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 69/151] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:54:56 2022] GET /identity/v3/users/151b1969fa6f4226a95c8e0b941835b6 => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:57.036285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:57.104593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283159c2-cb72-4b99-8278-0ad4c51df9ea None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:57.171430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:57.195661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:57.196547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:57.197007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:57.197607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:57.328522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1132496-2d75-48d9-8c24-ea25edc405e8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:57.374844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:57.376626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:57.464395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:57.465864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:57.466366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:57.466701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:57.474293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:57.477133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:57.480569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 70/152] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:57 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:57.484475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:57.487262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:57.583288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 83/153] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:54:57.603422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:57.807351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f035b5-08e1-4b78-9739-e10dac79d60d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:57.829703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5040-16e0-42b0-98ba-f2826e42cb5a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:57.869115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:57.869991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:57.870276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:57.870569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:57.874079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:57.875582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:57.878020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 84/154] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:54:57 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:57.901313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:57.906439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:57.943146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:57.949679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ccba5-803c-47d4-8e22-cfa50da2d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:57.950608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ccba5-803c-47d4-8e22-cfa50da2d5f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:57.950894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ccba5-803c-47d4-8e22-cfa50da2d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:57.951166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ccba5-803c-47d4-8e22-cfa50da2d5f3 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/151b1969fa6f4226a95c8e0b941835b6/roles/992ff3ff2e974a7ca11155a41f5ac10a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:57.953399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ccba5-803c-47d4-8e22-cfa50da2d5f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3cbbf04054e2fb4f841d3f285788d, user_id=151b1969fa6f4226a95c8e0b941835b6, role_id=992ff3ff2e974a7ca11155a41f5ac10a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:57.954902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ccba5-803c-47d4-8e22-cfa50da2d5f3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:58.055823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 71/155] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:54:57 2022] PUT /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/users/151b1969fa6f4226a95c8e0b941835b6/roles/992ff3ff2e974a7ca11155a41f5ac10a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:54:58.074216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979307-9e7d-4489-81f8-0f6573445107 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:58.137454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:58.138163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:58.138482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:58.138752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:58.139601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=5ddcc524dfeb40e8a8372a7177400fb4) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:58.139920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:58.141784 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1bd29-f9fe-4f73-9bfa-59102c756ccd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:58.149461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 85/156] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:54:57 2022] GET /identity/v3/role_assignments?user.id=5ddcc524dfeb40e8a8372a7177400fb4&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:54:58.624035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc180ab-a155-43bb-a500-91099d171fef None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:58.624913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc180ab-a155-43bb-a500-91099d171fef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:58.625048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc180ab-a155-43bb-a500-91099d171fef None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:58.627728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 72/157] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:58.640032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21497-0b45-4b06-954a-93a9e971ff29 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:58.640512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21497-0b45-4b06-954a-93a9e971ff29 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:58.641038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21497-0b45-4b06-954a-93a9e971ff29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:58.677959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d4e21497-0b45-4b06-954a-93a9e971ff29 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:58.680081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d4e21497-0b45-4b06-954a-93a9e971ff29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:58.776865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 86/158] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:58.822450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc180ab-a155-43bb-a500-91099d171fef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:58.833027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467aaf-1c53-4b97-b2c0-dd1ae1cf6dae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:58.833027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467aaf-1c53-4b97-b2c0-dd1ae1cf6dae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:58.833860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467aaf-1c53-4b97-b2c0-dd1ae1cf6dae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:58.842887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 87/159] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:58.845465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:58.845747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:58.846049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:58.881954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:58.883070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:58.900713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:59.061068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 88/160] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:54:59.162160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc180ab-a155-43bb-a500-91099d171fef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:59.169935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:59.288823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bef664-5fb7-4ea7-a8cd-1a2fab9c41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:59.288823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bef664-5fb7-4ea7-a8cd-1a2fab9c41e7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:59.288823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bef664-5fb7-4ea7-a8cd-1a2fab9c41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:59.288823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bef664-5fb7-4ea7-a8cd-1a2fab9c41e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:59.308015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bef664-5fb7-4ea7-a8cd-1a2fab9c41e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d2bef664-5fb7-4ea7-a8cd-1a2fab9c41e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:59.321840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:59.323608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 73/161] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:54:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:59.325170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a5e8-ab89-4766-8010-ead9e1f81e14 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:59.326564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a5e8-ab89-4766-8010-ead9e1f81e14 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:59.326564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66a5e8-ab89-4766-8010-ead9e1f81e14 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:59.327594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 74/162] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:54:59.347531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:59.347909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:59.348259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:59.386685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:54:59.388239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:54:59.416326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514337-5be5-417f-bc20-de061a02b06a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:59.459633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:59.496179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 75/163] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:54:59.497738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:59.612492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:59.613963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:59.614479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:59.614932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:59.654854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5752ccb-4424-418f-9b0b-4cbcde3bb3ca None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:54:59.690713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:54:59.710056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:54:59.711606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:54:59.713009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:54:59.722763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 89/164] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 553 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:54:59.724446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:59.727789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:54:59.729330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:54:59.730050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:54:59.730747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:54:59.732357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:54:59.733169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:54:59.735916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:54:59.754377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 76/165] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:54:59.757409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:54:59.762402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:54:59.830436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:00.059336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33836724-fd1e-4a1e-bc5b-ec9f794fcd2e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:00.074318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682ddc5-af7e-41cb-93da-24e2777601ff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:00.159431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:00.165255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:00.166003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:00.166498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:00.193693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:00.200045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:00.200045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:00.200045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:00.200045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:00.200045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:00.200436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:00.200512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:00.216155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:00.217209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:00.218021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:00.219139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 77/166] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:54:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:00.228235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:00.229439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 90/167] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:54:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:00.230681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:00.460868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:00.602365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:00.617555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b668cf9-b15f-4d8a-8653-44e97ea1669d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:00.622867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925f200-08e6-46f8-b1b0-b891c755d4f7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:00.732007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:00.735300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:00.735300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:00.735300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] PATH_INFO: `/v3/users/532c808ad3044d808c9b3565bd851ce1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:00.735936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] RBAC: Authorizing `identity:get_user(user_id=532c808ad3044d808c9b3565bd851ce1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:00.737918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:00.750103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 78/168] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:00 2022] GET /identity/v3/users/532c808ad3044d808c9b3565bd851ce1 => generated 247 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:00.751081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:00.752773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:00.753638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:00.755383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:00.755677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:00.762989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:00.765243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:00.766819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 91/169] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:00 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:00.767323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:01.047176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4136-1608-4a45-8f05-1813b8efb319 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:01.125201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:01.141344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5c265-3fc4-488a-852c-ae5c66359323 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:01.146385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53e4cf-65c6-4645-b2ca-76572030c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:01.149499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53e4cf-65c6-4645-b2ca-76572030c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.149499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53e4cf-65c6-4645-b2ca-76572030c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.149499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53e4cf-65c6-4645-b2ca-76572030c6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.187344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:01.189534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.189534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.189534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.189534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:01.190385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:01.191733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:01.201127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 79/170] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:01.206026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:01.245092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:01.270683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53e4cf-65c6-4645-b2ca-76572030c6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:01.272190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53e4cf-65c6-4645-b2ca-76572030c6d1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:01.354093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58b57f-5b6e-48d4-bc8b-0ec800725c77 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:01.395689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ac91-4221-4801-89a1-789ef9504e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:01.396344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ac91-4221-4801-89a1-789ef9504e82 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.396624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ac91-4221-4801-89a1-789ef9504e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.396929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ac91-4221-4801-89a1-789ef9504e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.441354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 92/171] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:01.443929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f88816-cf6d-48ce-b7df-4e2f1884d378 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.444514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f88816-cf6d-48ce-b7df-4e2f1884d378 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.445153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f88816-cf6d-48ce-b7df-4e2f1884d378 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.447930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 93/172] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:01.450409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f041c09-7938-4d58-8d0a-b86bec23023c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.451050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f041c09-7938-4d58-8d0a-b86bec23023c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.451674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f041c09-7938-4d58-8d0a-b86bec23023c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.456110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 94/173] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:01.457973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f041c09-7938-4d58-8d0a-b86bec23023c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:01.484242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ac91-4221-4801-89a1-789ef9504e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:01.486024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ac91-4221-4801-89a1-789ef9504e82 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:01.517954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:01.521768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:01.613782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 80/174] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:01.615451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0af77-41f7-4f6c-9af8-abe2c3494c4b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.615878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0af77-41f7-4f6c-9af8-abe2c3494c4b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.616275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0af77-41f7-4f6c-9af8-abe2c3494c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.644685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0ca0af77-41f7-4f6c-9af8-abe2c3494c4b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:01.647172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0ca0af77-41f7-4f6c-9af8-abe2c3494c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:01.653057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f041c09-7938-4d58-8d0a-b86bec23023c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:01.692431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:01.693672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.693952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.694358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] PATH_INFO: `/v3/users/5ddcc524dfeb40e8a8372a7177400fb4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.695728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] RBAC: Authorizing `identity:get_user(user_id=5ddcc524dfeb40e8a8372a7177400fb4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:01.697315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:01.699085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 95/175] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:01 2022] GET /identity/v3/users/5ddcc524dfeb40e8a8372a7177400fb4 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:01.704903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:01.738102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 81/176] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:01.740496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.741013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.741835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.764617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:01.765723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:01.830810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:01.840309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:01.844330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d3030-db28-4614-b3d4-91972a410e32 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:01.848458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 82/177] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:01.848874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:01.886979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:01.888223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:01.888673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:01.889409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:01.891070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:01.893844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:01.896761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 96/178] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:01 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:01.898781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:01.995325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768dded6-317d-4e67-a324-d0018ccdbed8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.032138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73248eff-e6fa-4e1c-b08d-8212219c13eb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.038584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.039449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.039727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.039998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] PATH_INFO: `/v3/projects/1448cc56f11440c1a8ea9620001f9ed3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.041478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] RBAC: Authorizing `identity:get_project(project_id=1448cc56f11440c1a8ea9620001f9ed3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.042937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.049503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 83/179] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:01 2022] GET /identity/v3/projects/1448cc56f11440c1a8ea9620001f9ed3 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:02.049503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.076651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.077333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.077612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.077885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.108728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:02.119635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:02.156038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.156651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db4507-4cfd-454b-b4be-944d8bbb3457 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.157659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.192468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.193302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.193580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.193858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.204167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:02.212483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:02.213821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 84/180] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:55:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:02.214792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.290265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 97/181] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:02.291124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.357641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:02.358552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b997dc-ecfe-4a19-9c9d-b286dc8e5845 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.374847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:02.391844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a600-69ae-4399-a6b8-3376a346d9ec None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.393903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b60e-c6cf-4288-a137-4c904749018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.394619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b60e-c6cf-4288-a137-4c904749018b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.394897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b60e-c6cf-4288-a137-4c904749018b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.395166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b60e-c6cf-4288-a137-4c904749018b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.396466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b60e-c6cf-4288-a137-4c904749018b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.398010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16b60e-c6cf-4288-a137-4c904749018b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.399770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 85/182] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:02.401215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b31a-f3d4-4ebf-95e3-127f166e9e5f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.401505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b31a-f3d4-4ebf-95e3-127f166e9e5f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.401780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2b31a-f3d4-4ebf-95e3-127f166e9e5f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.403139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 86/183] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:02.403891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2b31a-f3d4-4ebf-95e3-127f166e9e5f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.432654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.433255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.433532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.433800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.434625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=532c808ad3044d808c9b3565bd851ce1) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:02.434930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.436367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb4ae1-b275-431c-926e-022b06b18ab9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.443651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 98/184] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:02 2022] GET /identity/v3/role_assignments?user.id=532c808ad3044d808c9b3565bd851ce1&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:02.444968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501ca65-d391-4448-adfb-59490b0bd24e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.445253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501ca65-d391-4448-adfb-59490b0bd24e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.445526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501ca65-d391-4448-adfb-59490b0bd24e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.446825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 99/185] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:02.452018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501ca65-d391-4448-adfb-59490b0bd24e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.530833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2b31a-f3d4-4ebf-95e3-127f166e9e5f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.568593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.569301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.569579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.569856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.570703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=1448cc56f11440c1a8ea9620001f9ed3, user.id=5ddcc524dfeb40e8a8372a7177400fb4) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:02.571014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.572518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.579097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 87/186] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:02 2022] GET /identity/v3/role_assignments?user.id=5ddcc524dfeb40e8a8372a7177400fb4&scope.project.id=1448cc56f11440c1a8ea9620001f9ed3&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:02.579968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.601768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501ca65-d391-4448-adfb-59490b0bd24e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.644296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:02.652777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.653815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.654262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.654715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.656955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:02.656955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.658176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.668025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 100/187] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:02.669499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:02.669733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:02.745887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2ee2f-a4c3-4a69-8dcf-38ab1f62e362 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.794991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53929e4-f1da-41fe-946a-8e7729043934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.796077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53929e4-f1da-41fe-946a-8e7729043934 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.797076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53929e4-f1da-41fe-946a-8e7729043934 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.797389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53929e4-f1da-41fe-946a-8e7729043934 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.798741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53929e4-f1da-41fe-946a-8e7729043934 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.800748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53929e4-f1da-41fe-946a-8e7729043934 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.806925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 88/188] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:02 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:02.806925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f19a9-ad04-426e-9e79-025599c69b2a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.806925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f19a9-ad04-426e-9e79-025599c69b2a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.806925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f19a9-ad04-426e-9e79-025599c69b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.829606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87a69-329d-461a-9e31-0b074444cba7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:02.832163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5c4f19a9-ad04-426e-9e79-025599c69b2a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:02.833240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5c4f19a9-ad04-426e-9e79-025599c69b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:02.875533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:02.876332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.876589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.876955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.878494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:02.880472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:02.917249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 89/189] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:02.918616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:02.918908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:02.919181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:02.936722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:02.938141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:02.983520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.009096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 90/190] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:03.009965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.020120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 101/191] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:02 2022] POST /identity/v3/users => generated 297 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:03.023636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.102688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.169443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1e1f0-6e9b-4004-ab26-f3ef5fbd315d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.169655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b7b8-595a-4f21-b8e4-92940aefd792 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.214736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.215414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.215727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.216084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.217204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] RBAC: Adding query filter params (role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=5ddcc524dfeb40e8a8372a7177400fb4) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:03.217534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:03.219207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:03.219357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.220208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.220482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.221297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] PATH_INFO: `/v3/users/c51aa166264145cf8b61e695d25f471c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.227374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 102/192] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/role_assignments?user.id=5ddcc524dfeb40e8a8372a7177400fb4&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:03.228507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.252167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] RBAC: Authorizing `identity:get_user(user_id=c51aa166264145cf8b61e695d25f471c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:03.254052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:03.261475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 91/193] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/users/c51aa166264145cf8b61e695d25f471c => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:03.261475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.312895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.421786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd8cb0-1f12-44ec-baff-f37813cd5b88 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.434250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf0871-d82c-41b2-9fee-4429658b51e6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.443472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.478905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.480255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.480610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.480983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.493201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.493201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.493669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.494013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.501761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:03.509126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:03.510589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:03.512275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 103/194] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:03.514060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:03.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:03.523806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:03.525147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 92/195] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:03.532308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.652926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.660897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af715f1d-8065-46f1-b5c5-ab63864eccab None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.682135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9520-9a9a-4cf3-8ad6-198ae35fcf82 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.701656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.702450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.702803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.703137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.704263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:03.704649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:03.707619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:03.719310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 93/196] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:03.720632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.761945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.762659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.762883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.763154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.820950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.844616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c63f6-ae5a-49e1-b5c5-5cd3dd16b30c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:03.854769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:03.856377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:03.884634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:03.885346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:03.885624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:03.885902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:03.886929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:03.887231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:03.888833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:03.899128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 94/197] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:03.899999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:03.926985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:03.984018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 104/198] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:03.985208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.044967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d57955-6c7b-41a8-8099-212a5ebc324f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.079422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.088341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.089543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.090005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.090422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] PATH_INFO: `/v3/users/c51aa166264145cf8b61e695d25f471c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.092031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] RBAC: Authorizing `identity:get_user(user_id=c51aa166264145cf8b61e695d25f471c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.093788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.097039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 95/199] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/users/c51aa166264145cf8b61e695d25f471c => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:04.098739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.112697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b099f8-3dd4-43c2-9cf8-2bbc40a0dcec None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.161908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.161908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.162177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.162465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] PATH_INFO: `/v3/users/151b1969fa6f4226a95c8e0b941835b6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.165074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] RBAC: Authorizing `identity:get_user(user_id=151b1969fa6f4226a95c8e0b941835b6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.166351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.168315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 105/200] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:03 2022] GET /identity/v3/users/151b1969fa6f4226a95c8e0b941835b6 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:04.169449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.203588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.223019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70254796-f23a-4fc6-a883-bded516f8607 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.272024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.273226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.274035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.274450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.276154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.278286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.280272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 96/201] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:04.281377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.293397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640026a8-b6bd-4fe8-89ad-fea14891262a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.333483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.334080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.334361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.334640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.349174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.409168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ef03e-6ea7-4b24-9939-431669e115ea None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.415412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.416937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.448619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.449580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.450051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.450581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.478880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.528288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 106/202] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:04.529225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.532208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.535167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.577055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.653589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9304a6-0a21-4987-bab3-88e0c61238a2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.653771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 97/203] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:04.654498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.698515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.699376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.699847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.700232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.701209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=c51aa166264145cf8b61e695d25f471c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:04.701652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.703386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.710179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 107/204] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/role_assignments?user.id=c51aa166264145cf8b61e695d25f471c&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:04.711252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:04.721757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.844335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0be12-5298-4dbc-919e-bbc5ce3e69cf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.895826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d162b-22db-4cc0-998a-8463709d5e90 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:04.909180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:04.920231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:04.921278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:04.921570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:04.921844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:04.923208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:04.924718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:04.926742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 98/205] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:04.933187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:05.009544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:05.010488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.010772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.011043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.012388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:05.013910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:05.015720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 108/206] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:05.022575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:05.048374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdda31-5535-48f7-9877-c92a8a41e5b1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:05.074090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:05.087879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:05.088545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.088849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.089279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.090126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] RBAC: Adding query filter params (role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=c51aa166264145cf8b61e695d25f471c) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:05.090624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:05.092100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a593d-f0dc-4370-8942-207d5e5dc6a6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:05.105105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 99/207] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:04 2022] GET /identity/v3/role_assignments?user.id=c51aa166264145cf8b61e695d25f471c&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:05.249126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b895a9-fce8-4aab-a255-ab638dfe761f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:05.303171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:05.303931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.304165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.304455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.305378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] RBAC: Adding query filter params (role.id=992ff3ff2e974a7ca11155a41f5ac10a, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d, user.id=151b1969fa6f4226a95c8e0b941835b6) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:05.305688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:05.307164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5416c8-0872-4a8f-86c8-d8ac37944e56 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:05.320243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 109/208] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:05 2022] GET /identity/v3/role_assignments?user.id=151b1969fa6f4226a95c8e0b941835b6&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=992ff3ff2e974a7ca11155a41f5ac10a => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:05.834490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25218e-e4d7-4a3a-ab2c-402d528939ab None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.834870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25218e-e4d7-4a3a-ab2c-402d528939ab None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.835052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25218e-e4d7-4a3a-ab2c-402d528939ab None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.836441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 100/209] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:05.842501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.842796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.843078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.860036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:05.861830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:05.882396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f7ca-45c1-4c96-b8eb-dcd5fd1e57a4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.882830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f7ca-45c1-4c96-b8eb-dcd5fd1e57a4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.883109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1f7ca-45c1-4c96-b8eb-dcd5fd1e57a4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.884491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 101/210] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:05.891214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:05.891214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:05.891214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:05.908855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:05.910555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:05.911722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:05.966389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 110/211] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:05.992310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:05.994760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 102/212] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:06.024665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:06.109241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52911d0a-dd5c-4728-ae6e-e38e32497164 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:06.133187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69f88-8036-4b9d-a50c-7a00ef9c15b3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:06.147372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:06.148286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:06.148571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:06.148899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:06.150193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:06.151922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:06.152678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:06.154797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 111/213] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:06.161004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:06.175719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:06.176536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:06.176837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:06.177117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:06.191779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:06.202046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:06.203204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:06.204000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 103/214] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:06.205990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:06.211668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:06.283828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c4b4-85a4-4574-b431-74d30ec897af None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:06.326850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:06.328479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:06.328986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:06.329663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:06.331656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:06.333314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:06.348497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c698-6ca4-4e7d-a8a0-08f811879130 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:06.389724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:06.390319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:06.390600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:06.390875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:06.391875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:06.392180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:06.394298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:06.403363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 104/215] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:06.409132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:06.442333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 112/216] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:06 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:55:06.473842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:06.552886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c4a07-727c-4602-b098-781187e976a5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:06.594594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:06.597089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:06.597709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:06.598179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] PATH_INFO: `/v3/users/7f140c2c66c144c3b85f71611e1e4dfa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:06.616260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] RBAC: Authorizing `identity:get_user(user_id=7f140c2c66c144c3b85f71611e1e4dfa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:06.618344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:06.620408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 105/217] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:06 2022] GET /identity/v3/users/7f140c2c66c144c3b85f71611e1e4dfa => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:06.626160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:06.781176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:06.796846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a92659-4958-4cf4-b6ac-76c46d7b6244 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:06.860366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0567725-48c9-48b0-9278-023b98df2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:06.861567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567725-48c9-48b0-9278-023b98df2b8a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:06.862060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567725-48c9-48b0-9278-023b98df2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:06.862562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567725-48c9-48b0-9278-023b98df2b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:06.965684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567725-48c9-48b0-9278-023b98df2b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:06.967154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567725-48c9-48b0-9278-023b98df2b8a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:07.096994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:07.115054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 113/218] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:07.124045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:07.274450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fee5c-ed6e-424a-923a-a9b8dcada6e9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.274786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fee5c-ed6e-424a-923a-a9b8dcada6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.274996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fee5c-ed6e-424a-923a-a9b8dcada6e9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.276434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 114/219] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:07.282405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.282731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.283016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.321983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:07.323199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:07.359487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:07.371058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b8636-d559-4a07-a909-adc6dc652639 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:07.443419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:07.444292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.444565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.445120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.447393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:07.447626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:07.450545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 106/220] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:07 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:07.460729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:07.478087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 115/221] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:07.501971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:07.626350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770d74-25e4-41c3-95c2-014d03c1492e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:07.707115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:07.707787 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.708060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.708320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.709200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=7f140c2c66c144c3b85f71611e1e4dfa) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:07.709512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:07.710975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:07.723486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc01d4-72cf-42a6-9ef9-da854d9b0bd1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:07.727544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 107/222] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:07 2022] GET /identity/v3/role_assignments?user.id=7f140c2c66c144c3b85f71611e1e4dfa&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:07.760956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:07.775245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c4cb5-d596-40ad-b2de-5f3e3991ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:07.776056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4cb5-d596-40ad-b2de-5f3e3991ff52 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.777337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4cb5-d596-40ad-b2de-5f3e3991ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.777337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c4cb5-d596-40ad-b2de-5f3e3991ff52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.789350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c4cb5-d596-40ad-b2de-5f3e3991ff52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9c9c4cb5-d596-40ad-b2de-5f3e3991ff52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:07.798011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:07.800833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:07.802460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 116/223] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:07.810582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:07.868379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c92dc-d28a-4d20-82f0-bc8ccf614325 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.868759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c92dc-d28a-4d20-82f0-bc8ccf614325 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.869010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c92dc-d28a-4d20-82f0-bc8ccf614325 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.870741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 117/224] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:07.875921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:07.876260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:07.876552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:07.883164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:07.909372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:07.910622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:07.985657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5492-e41c-464b-844a-71b4faa9dd28 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:08.026397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:08.027082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:08.027364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:08.027723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:08.028497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:08.028820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:08.030301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:08.040081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 108/225] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:08.045710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:08.117707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 118/226] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:08.153434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:08.177160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:08.186467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18482e9-9ae2-4118-a045-a1b7828a8254 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:08.259511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:08.260468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:08.260752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:08.261924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] PATH_INFO: `/v3/users/c51aa166264145cf8b61e695d25f471c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:08.264019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c51aa166264145cf8b61e695d25f471c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:08.265772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:08.267769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 109/227] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:08 2022] GET /identity/v3/users/c51aa166264145cf8b61e695d25f471c => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:08.275314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:08.354016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d59f72-b581-4d12-b03e-ae0745eb3c3a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:08.381340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:08.422949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:08.424262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:08.424549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:08.424848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:08.439354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:08.460424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1106fa2-ffc2-44d8-a9a4-4a756ace50f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:08.460685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:08.462338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:08.463455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 119/228] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:08.474518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:08.568719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:08.569642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:08.569925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:08.570203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:08.573717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:08.575312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:08.577394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 110/229] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:08 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:08.588759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:08.659091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:08.692075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66d5b6-a59c-403c-b9e9-25632b9a57c8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:08.788457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:08.789620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:08.790101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:08.794250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:08.795727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:08.796278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:08.799505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:08.827582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 120/230] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:08.858023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:08.875241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c986a2a-b956-434d-b9de-2be816356167 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:08.935825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:08.953078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:08.953078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:08.953078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:08.953078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82/users/c51aa166264145cf8b61e695d25f471c/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:08.954285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845fc9a556433e86038123077c8a82, user_id=c51aa166264145cf8b61e695d25f471c, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:08.957791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:09.036185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 111/231] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:55:08 2022] PUT /identity/v3/projects/21845fc9a556433e86038123077c8a82/users/c51aa166264145cf8b61e695d25f471c/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:55:09.102343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4a49d-a986-4ea4-b640-f43c6604154d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:09.186630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:09.188200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:09.188749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:09.189822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] PATH_INFO: `/v3/users/c51aa166264145cf8b61e695d25f471c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:09.192197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] RBAC: Authorizing `identity:get_user(user_id=c51aa166264145cf8b61e695d25f471c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:09.194931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:09.198574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 121/232] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:08 2022] GET /identity/v3/users/c51aa166264145cf8b61e695d25f471c => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:09.208298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:09.413668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:09.445951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0df62-19d1-4cfb-a2ed-cf4de376c5a7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:09.511994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5058a6-aa9a-4549-a198-cc34a303e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:09.513375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5058a6-aa9a-4549-a198-cc34a303e35b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:09.513853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5058a6-aa9a-4549-a198-cc34a303e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:09.514325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5058a6-aa9a-4549-a198-cc34a303e35b None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:09.516722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5058a6-aa9a-4549-a198-cc34a303e35b None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:09.519936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5058a6-aa9a-4549-a198-cc34a303e35b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:09.523452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 112/233] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:09 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:09.532171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:09.687917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b272c-f236-4b0d-9376-1ac2d9690a13 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:09.690821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:09.739672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452555c7-1bc4-4d90-b494-4043c035c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:09.740633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452555c7-1bc4-4d90-b494-4043c035c6c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:09.740994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452555c7-1bc4-4d90-b494-4043c035c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:09.741226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452555c7-1bc4-4d90-b494-4043c035c6c9 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82/users/c51aa166264145cf8b61e695d25f471c/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:09.747046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452555c7-1bc4-4d90-b494-4043c035c6c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845fc9a556433e86038123077c8a82, user_id=c51aa166264145cf8b61e695d25f471c, role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:09.748542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452555c7-1bc4-4d90-b494-4043c035c6c9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:09.856720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 122/234] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:55:09 2022] PUT /identity/v3/projects/21845fc9a556433e86038123077c8a82/users/c51aa166264145cf8b61e695d25f471c/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:10.281652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40528cb-e0a2-4788-a1f7-ad98c6500935 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:10.284128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40528cb-e0a2-4788-a1f7-ad98c6500935 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:10.284917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40528cb-e0a2-4788-a1f7-ad98c6500935 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:10.288327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 113/235] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:10.294879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208694-3930-4c41-85d4-3d8b6626f27b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:10.295256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208694-3930-4c41-85d4-3d8b6626f27b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:10.295785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208694-3930-4c41-85d4-3d8b6626f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:10.322643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-36208694-3930-4c41-85d4-3d8b6626f27b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:10.325110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36208694-3930-4c41-85d4-3d8b6626f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:10.504843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 123/236] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:10.520463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe50c0-87d9-4810-bbb4-ec8346946ca7 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:10.521113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe50c0-87d9-4810-bbb4-ec8346946ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:10.521591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe50c0-87d9-4810-bbb4-ec8346946ca7 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:10.523234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 114/237] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:10.532169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:10.532682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:10.533330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:10.544440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe50c0-87d9-4810-bbb4-ec8346946ca7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:10.569646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:10.572420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:10.716675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 124/238] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:10.769038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:10.849375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:10.862866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe50c0-87d9-4810-bbb4-ec8346946ca7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:10.974625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:10.975450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:10.975732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:10.976006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:10.998951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e4276-d687-46d6-a619-26fa51fc3864 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:11.007867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:11.016030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:11.017351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:11.018271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:11.020720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 115/239] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:11.029869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:11.071347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:11.073088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.074905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:11.076107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.076872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.079545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:11.082776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:11.086773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 125/240] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:11.097697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:11.205198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1479a-8598-4c9f-aa0e-0af0fd1bf046 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:11.260124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:11.261205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.261691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.262165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.264004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:11.264523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:11.267056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be492ec-7911-4265-9385-d296858bc614 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:11.279838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 116/241] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:11.281640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02873434-4d72-4019-b28c-8eec45213f76 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.282177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02873434-4d72-4019-b28c-8eec45213f76 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.283675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02873434-4d72-4019-b28c-8eec45213f76 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.285609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 117/242] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:11.291134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02873434-4d72-4019-b28c-8eec45213f76 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:11.305903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:11.322233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832b187-3ad2-41ae-af94-b4e8e549fd9e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:11.388688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:11.390352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.391049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.392018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.394350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:11.396347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:11.398946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:11.426661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02873434-4d72-4019-b28c-8eec45213f76 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:11.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37882528-9384-4661-b719-00acec5c2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:11.471161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37882528-9384-4661-b719-00acec5c2047 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.471480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37882528-9384-4661-b719-00acec5c2047 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.471716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37882528-9384-4661-b719-00acec5c2047 None admin] PATH_INFO: `/v3/users/ec4921c3ec1a41749faf0c04daa90d51` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.487613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37882528-9384-4661-b719-00acec5c2047 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4921c3ec1a41749faf0c04daa90d51)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:11.489195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37882528-9384-4661-b719-00acec5c2047 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:11.497163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 118/243] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:11 2022] GET /identity/v3/users/ec4921c3ec1a41749faf0c04daa90d51 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:11.497163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.497163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.497163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.515386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 126/244] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:11 2022] POST /identity/v3/users => generated 293 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:55:11.518157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:11.527956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:11.530242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:11.672481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 119/245] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:11.743044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de76a-0e43-4f84-bddd-49ab3b4c0683 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:11.745294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:11.812498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:11.815287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:11.816015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:11.816699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:11.862400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:11.954564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:11.968236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:11.973181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:12.014458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e844f-60dd-4a67-be41-6131d5cbdcef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:12.055423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:12.056651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.057258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.057735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.070525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:12.079193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:12.080715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:12.082242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:12.087638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 120/246] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:12.101726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:12.163122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 127/247] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:12.175246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:12.239283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:12.274280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e644dc-0ff2-4ca4-9c26-663a573dcca0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:12.325273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:12.359792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:12.360078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfa808-2194-4eed-88d6-adec263f0837 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:12.361603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.362344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.363050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.364893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:12.365677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:12.369430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:12.388653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 121/248] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:12.398225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:12.442841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:12.444684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.445514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.446005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.448890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:12.453761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:12.460876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 128/249] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:12 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:12.465013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:12.551838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e4597-ddcd-4051-8dee-f770cb63ffdc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:12.599890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:12.601219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.601778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.602258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] PATH_INFO: `/v3/users/7f140c2c66c144c3b85f71611e1e4dfa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.603534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab53e-b0bd-453f-91c5-ec0729a43bf6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:12.604032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] RBAC: Authorizing `identity:get_user(user_id=7f140c2c66c144c3b85f71611e1e4dfa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:12.605969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:12.607903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 122/250] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:12 2022] GET /identity/v3/users/7f140c2c66c144c3b85f71611e1e4dfa => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:12.613775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:12.621080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:12.649118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:12.650089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.650539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.651084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.652312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] RBAC: Adding query filter params (role.id=992ff3ff2e974a7ca11155a41f5ac10a, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=ec4921c3ec1a41749faf0c04daa90d51) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:12.652942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:12.654696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:12.663375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 129/251] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:12 2022] GET /identity/v3/role_assignments?user.id=ec4921c3ec1a41749faf0c04daa90d51&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=992ff3ff2e974a7ca11155a41f5ac10a => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:12.721042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:12.783837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750752-2b5c-455b-b71c-9a8f3b5d6727 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:12.824551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b9da5-964f-416f-97f5-f5bbcabd530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:12.825471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b9da5-964f-416f-97f5-f5bbcabd530b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.825749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b9da5-964f-416f-97f5-f5bbcabd530b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.826020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b9da5-964f-416f-97f5-f5bbcabd530b None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.827283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b9da5-964f-416f-97f5-f5bbcabd530b None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:12.828774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b9da5-964f-416f-97f5-f5bbcabd530b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:12.831402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 123/252] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:12 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:12.836987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:12.884844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890b132-1458-493e-be43-6091065068eb None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.885090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890b132-1458-493e-be43-6091065068eb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.885421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890b132-1458-493e-be43-6091065068eb None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.887390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 124/253] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:12.897351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:12.897649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:12.898102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:12.930789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:12.932627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:13.035662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 125/254] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:13.048914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a25b-a30e-448f-b46e-8557f90db70c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:13.071719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:13.118777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d8741-6cc4-40b5-989f-407c3265ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:13.119693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d8741-6cc4-40b5-989f-407c3265ee19 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.119978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d8741-6cc4-40b5-989f-407c3265ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.120257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d8741-6cc4-40b5-989f-407c3265ee19 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82/users/7f140c2c66c144c3b85f71611e1e4dfa/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.123943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d8741-6cc4-40b5-989f-407c3265ee19 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845fc9a556433e86038123077c8a82, user_id=7f140c2c66c144c3b85f71611e1e4dfa, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:13.125666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d8741-6cc4-40b5-989f-407c3265ee19 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:13.156098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:13.216086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 130/255] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:55:12 2022] PUT /identity/v3/projects/21845fc9a556433e86038123077c8a82/users/7f140c2c66c144c3b85f71611e1e4dfa/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:13.217481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f21b-197c-4b77-8cc7-6f22918cc929 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.221359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f21b-197c-4b77-8cc7-6f22918cc929 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.221700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f21b-197c-4b77-8cc7-6f22918cc929 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.223503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 131/256] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:13.235250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.235250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.235250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.236398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e457e4d-d2ec-4fc1-ad90-ab961f1020cb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:13.269930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:13.271170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:13.282184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:13.283042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.284045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.284330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.299530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:13.309401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:13.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:13.313487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 126/257] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:55:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:13.321047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:13.347264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:13.454501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 132/258] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:13.499755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:13.507579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef474b6-bd3e-4689-a826-e38f0fb06340 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:13.539136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:13.623453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:13.624142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.624428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.624703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.625501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:13.625836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:13.628055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:13.655216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 127/259] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:13.660753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:13.760188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fce22f-246b-4b59-befe-3c62dd6049c5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:13.811832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:13.813092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.813626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.814171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.826829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:13.836278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:13.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:13.838622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:13.841182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 133/260] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:13.847835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:13.884165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:13.922541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a2ea-2234-400e-b9d7-0afd5279281d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:13.990472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:13.991505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:13.991784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:13.992060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] PATH_INFO: `/v3/users/c51aa166264145cf8b61e695d25f471c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:13.993359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] RBAC: Authorizing `identity:get_user(user_id=c51aa166264145cf8b61e695d25f471c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:13.994868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:13.996916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 128/261] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:13 2022] GET /identity/v3/users/c51aa166264145cf8b61e695d25f471c => generated 283 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:14.002330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:14.009803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a07a3d-bcee-4537-bd8a-5560329c42ca None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:14.050033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:14.051108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:14.051605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:14.052093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:14.053090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:14.053616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:14.055236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:14.065129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 134/262] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:14.071703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:14.082052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:14.186809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce4e91-8b1e-47e3-acc9-f637d89f4f4f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:14.207390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:14.218303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce70f8-f888-4b85-bd0f-c09cdac2a6b8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:14.265371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:14.266969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:14.268205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:14.268950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] PATH_INFO: `/v3/users/c51aa166264145cf8b61e695d25f471c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:14.270504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] RBAC: Authorizing `identity:get_user(user_id=c51aa166264145cf8b61e695d25f471c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:14.272514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:14.274670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 135/263] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:14 2022] GET /identity/v3/users/c51aa166264145cf8b61e695d25f471c => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:14.282300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:14.283612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:14.284373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:14.284722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:14.285088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:14.450326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:14.451921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:14.519001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004de0a-e0d6-4084-875d-c1fe8e8efd39 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:14.553277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:14.593079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:14.594079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:14.594371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:14.594652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:14.683247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:14.709657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 129/264] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:55:14.718823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:14.789984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:14.791917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:14.956631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 136/265] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:14.963893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:15.060683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:15.078888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e29efd-95e3-430a-b237-92baeb766f8d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:15.116621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a6729-e5bf-453c-bbd8-331ed4477d20 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:15.161188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:15.162368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:15.162650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:15.162984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:15.164249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:15.165988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:15.168169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 137/266] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:14 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:15.173834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:15.174395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:15.174765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:15.175052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:15.175321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:15.176644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:15.178231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:15.180150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 130/267] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:14 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:15.190045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:15.214451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:15.341422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767842-addb-4be5-bdc3-197fc61b0eac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:15.375302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35cad-72f7-4bb0-9957-e2cc49dce067 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:15.405413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:15.425918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:15.426636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:15.426924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:15.427201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:15.428183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] RBAC: Adding query filter params (role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=c51aa166264145cf8b61e695d25f471c) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:15.428536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:15.430388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ca3b9-8147-4325-985b-ef0ebe5e971c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:15.442559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 138/268] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:15 2022] GET /identity/v3/role_assignments?user.id=c51aa166264145cf8b61e695d25f471c&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:15.443772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:15.444826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:15.444826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:15.445114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:15.445864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=c51aa166264145cf8b61e695d25f471c) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:15.446183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:15.447750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeb081-fe6d-4efc-80e3-e01febf805e0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:15.463891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 131/269] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:15 2022] GET /identity/v3/role_assignments?user.id=c51aa166264145cf8b61e695d25f471c&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:15.699935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798709f-b196-4b6b-9f0c-4284827c09ff None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:15.700233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798709f-b196-4b6b-9f0c-4284827c09ff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:15.700627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798709f-b196-4b6b-9f0c-4284827c09ff None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:15.702311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 139/270] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:15.708942 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:15.709745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:15.709745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:15.733091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:15.734417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:15.827530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 132/271] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:15.868367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798709f-b196-4b6b-9f0c-4284827c09ff None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:16.001999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798709f-b196-4b6b-9f0c-4284827c09ff None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:16.044380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bb098-bd57-4c6d-952d-5bcbf9cc7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:16.045236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bb098-bd57-4c6d-952d-5bcbf9cc7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.045515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bb098-bd57-4c6d-952d-5bcbf9cc7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.045782 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bb098-bd57-4c6d-952d-5bcbf9cc7a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.047157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bb098-bd57-4c6d-952d-5bcbf9cc7a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:16.049677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bb098-bd57-4c6d-952d-5bcbf9cc7a5a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:16.051558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 140/272] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:16.057917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:16.061416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:16.209294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171ca7-c856-40e7-8de9-754f9a42ecff None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:16.265032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:16.265611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.265889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.266148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.267892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:16.269563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:16.357894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6647-efcf-4e29-a027-ccff50014611 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.358296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6647-efcf-4e29-a027-ccff50014611 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.358555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6647-efcf-4e29-a027-ccff50014611 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.360219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 141/273] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:16.366575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.366843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.367105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.381097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 133/274] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:16 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:16.390676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:16.394685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:16.525858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:16.554404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 142/275] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:16.581261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:16.668519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:16.722940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107a45f-3edf-482e-815b-b29d8d05cf09 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:16.769252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372d07b-3832-48f2-a373-80bf4593ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:16.770482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d07b-3832-48f2-a373-80bf4593ff2e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.770967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d07b-3832-48f2-a373-80bf4593ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.771452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d07b-3832-48f2-a373-80bf4593ff2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.785254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372d07b-3832-48f2-a373-80bf4593ff2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a372d07b-3832-48f2-a373-80bf4593ff2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:16.793334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:16.794253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:16.795142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:16.797637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 134/276] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:16.804411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:16.809119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7aaed-1c57-437c-a6b2-fa666cac00b0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.809390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7aaed-1c57-437c-a6b2-fa666cac00b0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.809666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7aaed-1c57-437c-a6b2-fa666cac00b0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.811200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 135/277] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:16.818286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0a8d-44d6-493b-a908-bcbefac06a16 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.818685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0a8d-44d6-493b-a908-bcbefac06a16 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.819096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f0a8d-44d6-493b-a908-bcbefac06a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.847715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-673f0a8d-44d6-493b-a908-bcbefac06a16 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:16.850420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-673f0a8d-44d6-493b-a908-bcbefac06a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:16.957831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3b0f1-23fb-4568-8635-2d9898a43b2d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:16.994580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 136/278] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:16.996060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf781-a15c-4afb-b926-b018073f24bd None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:16.996348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf781-a15c-4afb-b926-b018073f24bd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:16.996622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddf781-a15c-4afb-b926-b018073f24bd None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:16.998315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 137/279] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:17.009045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.009308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.009582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.021904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.022755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.022892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.023138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.024052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:17.024423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:17.025931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:17.036658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:17.037143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 143/280] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:17.037834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:17.038024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.102024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:17.103912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:17.131853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 138/281] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:17.132839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.183109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96d379-6c73-4c4e-8377-bee7674d4c74 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:17.221069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.221953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.222237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.222560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.234394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:17.242817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:17.243885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 144/282] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:17.244764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.276115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c987a4-3256-4f17-b49c-a32a71770f99 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:17.347376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.348728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.349222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.349687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] PATH_INFO: `/v3/users/ec4921c3ec1a41749faf0c04daa90d51` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.351673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4921c3ec1a41749faf0c04daa90d51)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:17.354358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:17.357760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 139/283] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/users/ec4921c3ec1a41749faf0c04daa90d51 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:17.359150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.459479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:17.469617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32948001-3173-4572-80c7-d0bd0dabc6b2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:17.493407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:17.531527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.533053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.533759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.534345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.555286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:17.564402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c26a53-3ebb-4850-b335-2245e20a37d3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:17.571447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:17.573220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:17.574709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:17.581403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 145/284] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:17.582887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.631566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.632874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.633340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.633796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.635301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:17.636217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:17.639201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:17.656304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 140/285] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:17.661865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.771893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d148-dde0-4d49-96ef-53b7b4b2184d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:17.838044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.839353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.839809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.840263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.842334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:17.846483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:17.850226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 146/286] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:17.851881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.865690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96751-2601-4fcc-9084-7abe7d8eedc0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:17.884428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:17.916108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:17.917104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:17.917529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:17.917943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:17.918999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:17.919520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:17.921268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:17.931227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 141/287] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:17.937309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:17.947718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:18.059690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683f5ae-7dd4-4fb5-8a46-7f3cb0521d09 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:18.105613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:18.106968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:18.107473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:18.107947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] PATH_INFO: `/v3/users/7f140c2c66c144c3b85f71611e1e4dfa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:18.109713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f140c2c66c144c3b85f71611e1e4dfa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:18.111603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:18.113961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 147/288] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:17 2022] GET /identity/v3/users/7f140c2c66c144c3b85f71611e1e4dfa => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:18.115115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:18.129727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aac01-00c7-4aa1-b6ec-5cd1ddd739f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:18.179612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:18.181709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:18.182881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:18.183382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82/users/ec4921c3ec1a41749faf0c04daa90d51/roles/992ff3ff2e974a7ca11155a41f5ac10a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:18.187386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845fc9a556433e86038123077c8a82, user_id=ec4921c3ec1a41749faf0c04daa90d51, role_id=992ff3ff2e974a7ca11155a41f5ac10a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:18.190543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:18.339733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 142/289] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:55:17 2022] PUT /identity/v3/projects/21845fc9a556433e86038123077c8a82/users/ec4921c3ec1a41749faf0c04daa90d51/roles/992ff3ff2e974a7ca11155a41f5ac10a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:18.347100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:18.349735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0acb9-4a9a-46ef-96d6-0eab1a0fbea1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:18.379002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:18.462317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:18.482616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:18.484189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:18.484189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:18.484189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] PATH_INFO: `/v3/users/1e5af60b5d6e4c98b4a8711ac1121bfe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:18.517118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] RBAC: Authorizing `identity:get_user(user_id=1e5af60b5d6e4c98b4a8711ac1121bfe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:18.518973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:18.527675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 148/290] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:18 2022] GET /identity/v3/users/1e5af60b5d6e4c98b4a8711ac1121bfe => generated 293 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:18.535837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:18.640269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92186015-2962-43b4-89bb-29a997a46ab6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:18.741454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2959c-8101-4056-8382-1e3fb5bdd8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:18.742847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2959c-8101-4056-8382-1e3fb5bdd8ba None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:18.743483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2959c-8101-4056-8382-1e3fb5bdd8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:18.744129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2959c-8101-4056-8382-1e3fb5bdd8ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:18.797647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763820b-812a-4796-90fb-f20c6e8ac3ac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:18.872173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:18.873796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:18.874541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:18.876227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:18.882623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, user.id=1e5af60b5d6e4c98b4a8711ac1121bfe, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:18.883617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:18.890261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:18.920575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 149/291] 10.222.0.71 () {56 vars in 1308 bytes} [Wed May 18 13:55:18 2022] GET /identity/v3/role_assignments?user.id=1e5af60b5d6e4c98b4a8711ac1121bfe&scope.system=all&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 226 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:18.965606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2959c-8101-4056-8382-1e3fb5bdd8ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:18.969523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2959c-8101-4056-8382-1e3fb5bdd8ba None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:19.044470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:19.256965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 143/292] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 903 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:19.262101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:19.358474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:19.549850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666e98b-4018-49cb-b044-2a2920fdb4de None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:19.629966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85ecd6-01a7-44cb-a1b8-eca3e4532a5e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:19.630792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfea87-f0ff-4dd7-b192-75f4da4853c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:19.631252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85ecd6-01a7-44cb-a1b8-eca3e4532a5e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:19.631667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfea87-f0ff-4dd7-b192-75f4da4853c1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:19.631948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfea87-f0ff-4dd7-b192-75f4da4853c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:19.632215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfea87-f0ff-4dd7-b192-75f4da4853c1 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:19.632885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85ecd6-01a7-44cb-a1b8-eca3e4532a5e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:19.633523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfea87-f0ff-4dd7-b192-75f4da4853c1 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:19.634993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfea87-f0ff-4dd7-b192-75f4da4853c1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:19.636662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 144/293] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:19.637603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 150/294] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:19 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:19.644212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85ecd6-01a7-44cb-a1b8-eca3e4532a5e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:19.650791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:19.650791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:19.650791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:19.668034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:19.669321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:19.811241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 151/295] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:19.846839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85ecd6-01a7-44cb-a1b8-eca3e4532a5e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:19.877700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:19.887623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:19.894403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:19.895078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:19.895360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:19.895636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:19.896484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=7f140c2c66c144c3b85f71611e1e4dfa) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:19.896816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:19.900252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:19.915393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 145/296] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:19 2022] GET /identity/v3/role_assignments?user.id=7f140c2c66c144c3b85f71611e1e4dfa&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:19.949542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:20.059634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb077-00a7-4eb9-92bb-e9a0dd692480 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:20.117716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564d8d7-2431-48de-a579-732695a04fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:20.118554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d8d7-2431-48de-a579-732695a04fde None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:20.118836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d8d7-2431-48de-a579-732695a04fde None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:20.119111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564d8d7-2431-48de-a579-732695a04fde None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:20.120520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d8d7-2431-48de-a579-732695a04fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:20.122059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564d8d7-2431-48de-a579-732695a04fde None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:20.123817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 152/297] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:20.130020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:20.280689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d552e-b944-4420-9f4b-9288f4b40427 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:20.320093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1cdb3-9ed9-469b-aa42-e7de1bf35630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:20.320817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1cdb3-9ed9-469b-aa42-e7de1bf35630 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:20.321114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1cdb3-9ed9-469b-aa42-e7de1bf35630 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:20.321395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1cdb3-9ed9-469b-aa42-e7de1bf35630 None admin] PATH_INFO: `/v3/groups` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:20.322136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1cdb3-9ed9-469b-aa42-e7de1bf35630 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:20.323688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1cdb3-9ed9-469b-aa42-e7de1bf35630 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:20.423687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 146/298] 10.222.0.71 () {60 vars in 1134 bytes} [Wed May 18 13:55:20 2022] POST /identity/v3/groups => generated 229 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:20.619830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cbbe3-7492-446a-9b83-6b62a3abb6da None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:20.620316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cbbe3-7492-446a-9b83-6b62a3abb6da None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:20.620723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cbbe3-7492-446a-9b83-6b62a3abb6da None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:20.623586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 153/299] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:20.631016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:20.631519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:20.631954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:20.664467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:20.666630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:20.752826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:20.773454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 147/300] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:20.797145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cbbe3-7492-446a-9b83-6b62a3abb6da None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:20.953481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:20.966740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cbbe3-7492-446a-9b83-6b62a3abb6da None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:21.028493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743280-1803-4ab0-a446-6f1d01ec5176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:21.029902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743280-1803-4ab0-a446-6f1d01ec5176 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.030393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743280-1803-4ab0-a446-6f1d01ec5176 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.030880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743280-1803-4ab0-a446-6f1d01ec5176 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.049881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743280-1803-4ab0-a446-6f1d01ec5176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-47743280-1803-4ab0-a446-6f1d01ec5176 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:21.065561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:21.066536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:21.067351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:21.068536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 154/301] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:21.076514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:21.272090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75660-1e9b-4cd2-9f8f-07f4010c9203 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:21.322075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:21.323161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.323450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.323728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.324819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:21.325203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:21.326883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:21.333015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a77b5-ef7d-4f40-ac39-1c8cf1942555 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.333630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a77b5-ef7d-4f40-ac39-1c8cf1942555 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.334129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a77b5-ef7d-4f40-ac39-1c8cf1942555 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.335756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 155/302] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:21.341496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.342088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.342564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.346135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 148/303] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:21.351342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:21.376996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:21.379589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:21.423701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:21.481856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8a97-50c0-4db6-96be-4c71f0d73238 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:21.513383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 156/304] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:21.520417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:21.521463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.521848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.522240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] PATH_INFO: `/v3/users/b13d8dec90f54c6ebaf80f3993c4c2a1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.538093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] RBAC: Authorizing `identity:get_user(user_id=b13d8dec90f54c6ebaf80f3993c4c2a1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:21.539708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:21.541922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 149/305] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:21 2022] GET /identity/v3/users/b13d8dec90f54c6ebaf80f3993c4c2a1 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:21.550290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:21.550796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:21.665765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ade85-af75-4cbd-91b1-51705a5d0722 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:21.674252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:21.697316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:21.707494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:21.708329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.708611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.708938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.716938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d8a2d-a0c6-40e9-822d-17050e2d43a5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:21.721228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:21.730554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:21.735550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:21.736709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:21.738490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 150/306] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:21.738490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:21.789947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:21.791621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.792422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.793165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.794530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] RBAC: Adding query filter params (role.id=992ff3ff2e974a7ca11155a41f5ac10a, user.id=b13d8dec90f54c6ebaf80f3993c4c2a1, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:21.795362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:21.800326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e13f74-208b-4da1-99e8-540a5263ba94 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:21.811172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 157/307] 10.222.0.71 () {56 vars in 1308 bytes} [Wed May 18 13:55:21 2022] GET /identity/v3/role_assignments?user.id=b13d8dec90f54c6ebaf80f3993c4c2a1&scope.system=all&role.id=992ff3ff2e974a7ca11155a41f5ac10a => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:21.857015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1254ee-dd48-4701-921e-e7503ee0c445 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:21.887702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9cdc5-639e-4a96-8638-a0cb45f01f4d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.888372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9cdc5-639e-4a96-8638-a0cb45f01f4d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.888879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9cdc5-639e-4a96-8638-a0cb45f01f4d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.890893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 158/308] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:21.897453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.898088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.898684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.906294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:21.906635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:21.907049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:21.908083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:21.909014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:21.909333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:21.911224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:21.921020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:21.922642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:21.924565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 151/309] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:21.929963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:21.986822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:22.047165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 159/310] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:22.084946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:22.111020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dc382-33b9-44b7-a9c9-499dcd43a5c3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.177269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:22.180120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.180856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.181773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] PATH_INFO: `/v3/users/ec4921c3ec1a41749faf0c04daa90d51` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.184814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] RBAC: Authorizing `identity:get_user(user_id=ec4921c3ec1a41749faf0c04daa90d51)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:22.189280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:22.194166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 152/311] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:21 2022] GET /identity/v3/users/ec4921c3ec1a41749faf0c04daa90d51 => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:22.200847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:22.205501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:22.227233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe21e0-71d1-4a52-8b51-f0e80f9cae08 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.270790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:22.271849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.272305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.272723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.286271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:22.294506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:22.295507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:22.296287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:22.303849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 160/312] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:22.305567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:22.386169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:22.395811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d61b71-67cd-40b3-9a5b-84e01c8ccd0f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.428200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46205b-78c8-410b-8bee-996a0ce3d014 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.445364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:22.446306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.446796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.447117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.469399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:22.470973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.471431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.471872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.472822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:22.473323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:22.475035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:22.481221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:22.486838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 161/313] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:22.493182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:22.554325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:22.556134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:22.618884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b1f39-e401-4432-9138-8f5979589eb0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.659137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:22.660530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.661073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.661556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] PATH_INFO: `/v3/users/1e5af60b5d6e4c98b4a8711ac1121bfe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.663378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] RBAC: Authorizing `identity:get_user(user_id=1e5af60b5d6e4c98b4a8711ac1121bfe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:22.665328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:22.667597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 162/314] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:22 2022] GET /identity/v3/users/1e5af60b5d6e4c98b4a8711ac1121bfe => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:22.674242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:22.731986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:22.745287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 153/315] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:22.755255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:22.767837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:22.814986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d786d3-d73d-4f8b-9031-06ed3999d468 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.857566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a297c-2de7-4b66-9c48-c6f7256be046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:22.859016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a297c-2de7-4b66-9c48-c6f7256be046 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.859556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a297c-2de7-4b66-9c48-c6f7256be046 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.860039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a297c-2de7-4b66-9c48-c6f7256be046 None admin] PATH_INFO: `/v3/system/users/1e5af60b5d6e4c98b4a8711ac1121bfe/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.862581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a297c-2de7-4b66-9c48-c6f7256be046 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e5af60b5d6e4c98b4a8711ac1121bfe, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:22.864376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a297c-2de7-4b66-9c48-c6f7256be046 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:22.963739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 163/316] 10.222.0.71 () {58 vars in 1334 bytes} [Wed May 18 13:55:22 2022] PUT /identity/v3/system/users/1e5af60b5d6e4c98b4a8711ac1121bfe/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:55:22.977603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef7dfc-4d58-4805-899c-1d4a50cffeec None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:22.980816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea363-364d-4068-abcc-e54fd88bf691 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.981308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea363-364d-4068-abcc-e54fd88bf691 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.981731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea363-364d-4068-abcc-e54fd88bf691 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:22.993898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 164/317] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:22.993898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:22.993898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:22.993898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:23.022392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:23.024375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:23.044633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:23.046059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:23.046614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:23.047646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:23.050659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:23.052837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:23.055994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 154/318] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:22 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:23.065917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:23.126135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 165/319] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:23.151066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:23.203684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:23.233086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:23.290872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d16699-6a1a-42a9-ae5d-62a9e03ca658 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:23.291337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df107c-643f-469f-91ee-78fb67c8bcce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:23.350869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:23.351247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:23.351649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:23.351939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:23.352824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] RBAC: Adding query filter params (role.id=992ff3ff2e974a7ca11155a41f5ac10a, scope.project.id=21845fc9a556433e86038123077c8a82, user.id=ec4921c3ec1a41749faf0c04daa90d51) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:23.353148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:23.360112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:23.362531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6341fe2-4998-465b-b5fa-b3b56e2381ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:23.362884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 155/320] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:23 2022] GET /identity/v3/role_assignments?user.id=ec4921c3ec1a41749faf0c04daa90d51&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=992ff3ff2e974a7ca11155a41f5ac10a => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:23.364298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341fe2-4998-465b-b5fa-b3b56e2381ee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:23.364814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341fe2-4998-465b-b5fa-b3b56e2381ee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:23.365334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341fe2-4998-465b-b5fa-b3b56e2381ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:23.367718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6341fe2-4998-465b-b5fa-b3b56e2381ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:23.370796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6341fe2-4998-465b-b5fa-b3b56e2381ee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:23.374623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 166/321] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:23.388986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:23.557085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2806a03-a2df-4367-a184-e4895002fdf5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:23.599789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:23.618350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf264b4-d195-40cb-8503-6a3a204589c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:23.618350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf264b4-d195-40cb-8503-6a3a204589c2 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:23.618735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf264b4-d195-40cb-8503-6a3a204589c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:23.620211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf264b4-d195-40cb-8503-6a3a204589c2 None admin] PATH_INFO: `/v3/groups` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:23.620854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf264b4-d195-40cb-8503-6a3a204589c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:23.623320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf264b4-d195-40cb-8503-6a3a204589c2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:23.760067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 156/322] 10.222.0.71 () {60 vars in 1134 bytes} [Wed May 18 13:55:23 2022] POST /identity/v3/groups => generated 226 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:55:24.750941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f79d3-299f-4106-8fb7-1cbe9fa4605a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:24.751596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f79d3-299f-4106-8fb7-1cbe9fa4605a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:24.751916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f79d3-299f-4106-8fb7-1cbe9fa4605a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:24.754911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 167/323] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:24.764451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:24.765082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:24.765536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:24.804819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:24.806844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:24.970939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 157/324] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:25.017923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f79d3-299f-4106-8fb7-1cbe9fa4605a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:25.161491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f79d3-299f-4106-8fb7-1cbe9fa4605a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:25.200175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:25.207913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:25.208753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:25.209057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:25.209328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:25.244557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:25.250321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:25.251481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:25.252287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 168/325] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:25.267478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:25.481410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16605459-651a-4397-ab2f-78f46f01f446 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:25.503233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:25.522278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:25.522950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:25.523271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:25.523506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:25.524257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:25.524554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:25.526010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:25.545103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 158/326] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:25.553211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:25.754757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d68fd6-af5e-414f-ad2a-bfd485399600 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:25.837843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109a89-b9b0-439d-bda3-59492c744368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:25.839331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109a89-b9b0-439d-bda3-59492c744368 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:25.839798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109a89-b9b0-439d-bda3-59492c744368 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:25.840277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109a89-b9b0-439d-bda3-59492c744368 None admin] PATH_INFO: `/v3/users/b13d8dec90f54c6ebaf80f3993c4c2a1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:25.846134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109a89-b9b0-439d-bda3-59492c744368 None admin] RBAC: Authorizing `identity:get_user(user_id=b13d8dec90f54c6ebaf80f3993c4c2a1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:25.848879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109a89-b9b0-439d-bda3-59492c744368 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:25.852196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 169/327] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:25 2022] GET /identity/v3/users/b13d8dec90f54c6ebaf80f3993c4c2a1 => generated 293 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:25.862489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:26.078172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7f13-b06f-474c-9389-0514096b02c8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:26.143975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3155f03-e978-4cd5-b5c8-d62d2a4b45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:26.144484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155f03-e978-4cd5-b5c8-d62d2a4b45a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:26.144670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155f03-e978-4cd5-b5c8-d62d2a4b45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:26.144947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155f03-e978-4cd5-b5c8-d62d2a4b45a8 None admin] PATH_INFO: `/v3/system/users/b13d8dec90f54c6ebaf80f3993c4c2a1/roles/992ff3ff2e974a7ca11155a41f5ac10a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:26.146516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3155f03-e978-4cd5-b5c8-d62d2a4b45a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b13d8dec90f54c6ebaf80f3993c4c2a1, role_id=992ff3ff2e974a7ca11155a41f5ac10a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:26.148501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3155f03-e978-4cd5-b5c8-d62d2a4b45a8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:26.245317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 159/328] 10.222.0.71 () {58 vars in 1334 bytes} [Wed May 18 13:55:25 2022] PUT /identity/v3/system/users/b13d8dec90f54c6ebaf80f3993c4c2a1/roles/992ff3ff2e974a7ca11155a41f5ac10a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:26.438852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024203-34e1-4731-aa8a-a7a3abc95f24 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:26.439863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024203-34e1-4731-aa8a-a7a3abc95f24 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:26.440656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024203-34e1-4731-aa8a-a7a3abc95f24 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:26.444051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 170/329] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:26.450667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:26.450952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:26.451252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:26.475508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:26.476743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:26.534179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:26.564802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 160/330] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:26.600706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024203-34e1-4731-aa8a-a7a3abc95f24 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:26.751362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:26.871441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024203-34e1-4731-aa8a-a7a3abc95f24 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:26.958078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a0957-f885-4c97-bf1e-143e407b8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:26.959955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0957-f885-4c97-bf1e-143e407b8f58 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:26.960747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0957-f885-4c97-bf1e-143e407b8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:26.961659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0957-f885-4c97-bf1e-143e407b8f58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:26.985748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a0957-f885-4c97-bf1e-143e407b8f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ce1a0957-f885-4c97-bf1e-143e407b8f58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:27.003818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:27.005632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:27.007219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:27.015505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 171/331] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:27.022266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:27.130276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e56b-31cc-418f-a8d5-13622608f15b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.131277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e56b-31cc-418f-a8d5-13622608f15b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.132012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603e56b-31cc-418f-a8d5-13622608f15b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.136691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 172/332] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:27.147917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4256-854a-433c-afce-b348d56d247c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.148877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4256-854a-433c-afce-b348d56d247c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.149648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e4256-854a-433c-afce-b348d56d247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.168826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7708-2aed-456e-b118-f11561a06c9e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:27.202503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c99e4256-854a-433c-afce-b348d56d247c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:27.206038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c99e4256-854a-433c-afce-b348d56d247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:27.209282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:27.213174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.213174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.213174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.213174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:27.213174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:27.213174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:27.222895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 161/333] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:27.231998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:27.318735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:27.364616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 173/334] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:27.438711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4256-854a-433c-afce-b348d56d247c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:27.444445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1eb176-bf6e-4954-951c-c1e531b66def None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:27.532479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:27.533598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.533878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.534152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] PATH_INFO: `/v3/users/1e5af60b5d6e4c98b4a8711ac1121bfe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.535444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] RBAC: Authorizing `identity:get_user(user_id=1e5af60b5d6e4c98b4a8711ac1121bfe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:27.537040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:27.539848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 162/335] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:27 2022] GET /identity/v3/users/1e5af60b5d6e4c98b4a8711ac1121bfe => generated 293 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:27.542314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:27.548174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:27.653308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e4256-854a-433c-afce-b348d56d247c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:27.698827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:27.699668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.699948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.705351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.721579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:27.729894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:27.731699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:27.733338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 174/336] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:27.741894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:27.762962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e10d-6bc6-4d7c-8931-712c33f66d54 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:27.768144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:27.809019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:27.809713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.809995 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.810280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.811139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] RBAC: Adding query filter params (role.id=fdc0b94e97b748159f3e6d678394e34e, user.id=1e5af60b5d6e4c98b4a8711ac1121bfe, scope.system=all) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:27.811453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:27.814801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:27.828555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 163/337] 10.222.0.71 () {56 vars in 1308 bytes} [Wed May 18 13:55:27 2022] GET /identity/v3/role_assignments?user.id=1e5af60b5d6e4c98b4a8711ac1121bfe&scope.system=all&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 510 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:27.923714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f99e3-7efb-4090-aacd-11efa30ad726 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:27.941754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:27.977756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:27.978450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:27.978729 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:27.978999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:27.982727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:27.982727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:27.982727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07326549-90fd-42c4-b294-b3a4f8ffdcde None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:27.992245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 175/338] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:28.001976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:28.087583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b806de-57c0-48bf-a9d4-3586a73844c0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:28.088033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b806de-57c0-48bf-a9d4-3586a73844c0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:28.088179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b806de-57c0-48bf-a9d4-3586a73844c0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:28.089718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 176/339] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:28.096056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:28.096355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:28.096677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:28.134725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:28.136022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:28.169108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3d3cb-9b0e-4999-85c4-e035d95b50c0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:28.226067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:28.226645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:28.226937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:28.227213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:28.271699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 177/340] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:28.297253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:28.332383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:28.348747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:28.350237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:28.467894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 164/341] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:28.484500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:28.575294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:28.599603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0173448-65c3-4634-9880-9d40a9ca7315 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:28.639372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:28.640419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:28.640822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:28.641246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:28.642932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:28.644526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:28.646856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 165/342] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:28 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:28.664320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:28.696711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:28.704714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bf968-2b21-4c0c-9356-00c0fbd7b3d7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:28.780557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529d127-3fd2-4f30-a99c-a6e179c97f82 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:28.815999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:28.822012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:28.822895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:28.823188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:28.823448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:28.831109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:28.832779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:28.834992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 166/343] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:28 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:28.835774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:28.840819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:28.840819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:28.840819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:28.843032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:28.870263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:28.893528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:28.894520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:28.895323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 178/344] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 564 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:28.910190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:28.987513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275368f-1b82-4bff-8c99-b3ceab2152e8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:29.047233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:29.048340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:29.048958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:29.049464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:29.050509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:29.051054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:29.052741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:29.069003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 167/345] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:28 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:29.167128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea5ef-522b-4c7d-ab3e-f430f036deb3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:29.255625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:29.256713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:29.257211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:29.257672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:29.259037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:29.259544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:29.262037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:29.283637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 179/346] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:29.290633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:29.446294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:29.539379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf326a-52d3-4259-83f6-5bb1f3b12a56 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:29.611941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:29.613055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:29.613517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:29.613992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:29.755504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:29.758224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:29.877465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:29.963511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 168/347] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:29.973356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:30.059454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:30.235796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58bfe7-b78c-4cdb-b2b4-d8ddf774efc8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:30.317606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5494-6bcc-4071-aed2-54c4e0a22ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:30.319009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5494-6bcc-4071-aed2-54c4e0a22ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.319481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5494-6bcc-4071-aed2-54c4e0a22ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.319969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5494-6bcc-4071-aed2-54c4e0a22ac5 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.326409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db5494-6bcc-4071-aed2-54c4e0a22ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:30.330117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db5494-6bcc-4071-aed2-54c4e0a22ac5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:30.333599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 180/348] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:29 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:30.340293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:30.406006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808f73-7843-41f5-acf3-a0c1b8017c74 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.406337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808f73-7843-41f5-acf3-a0c1b8017c74 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.406564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808f73-7843-41f5-acf3-a0c1b8017c74 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.408340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 181/349] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:30.419527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832cc7-1954-4786-937e-418d468ea913 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.419829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832cc7-1954-4786-937e-418d468ea913 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.420081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832cc7-1954-4786-937e-418d468ea913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.449173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-52832cc7-1954-4786-937e-418d468ea913 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:30.450397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-52832cc7-1954-4786-937e-418d468ea913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:30.549445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 182/350] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:30.569848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03de80-d91b-4742-a261-8113791f1341 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.570043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03de80-d91b-4742-a261-8113791f1341 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.570330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03de80-d91b-4742-a261-8113791f1341 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.571762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 183/351] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:30.581156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.581457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.581706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.604926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa57739-f755-4836-862f-31af43ba922c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:30.624313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:30.625684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:30.649108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:30.649984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.650331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.650601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.652217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:30.653716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:30.655605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 169/352] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:30 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:30.661100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:30.670378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:30.715442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:30.764020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 184/353] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:30.765032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:30.815878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245861c-eece-4976-8408-546ea8dda647 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:30.859045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:30.859788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:30.860361 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:30.860987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:30.874271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:30.884051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:30.885099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:30.885949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 170/354] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:30.887376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:30.995697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd695b8-672a-424b-8992-3f2d8f24ec94 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:31.075224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:31.075894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:31.076598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:31.079247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:31.080662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:31.081201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:31.086857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:31.094034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:31.100690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 185/355] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:30 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 260 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:31.105036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:31.126277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c439-40e6-4aa5-9ce8-21aaf0a680f3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:31.145155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:31.211353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:31.212177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:31.212460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:31.212732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:31.253119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:31.269253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:31.270221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:31.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 171/356] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:31.276860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:31.285648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f06ab5-eb49-425c-9c75-c1314e08d486 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:31.335880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:31.336586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:31.336895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:31.337172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:31.338247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:31.338569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:31.340148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:31.357894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 186/357] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:31.363514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:31.502116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:31.536161 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848db0a8-9723-4a1a-b904-2f8a8ba5d9ce None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:31.552820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937064-9a99-46dc-88fa-f6ce265d1454 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:31.589769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:31.590472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:31.590755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:31.591030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:31.604575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:31.605320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:31.605608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:31.605889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:31.606715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:31.607027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:31.608564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:31.623265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 172/358] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:31.629858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:31.644367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:31.700222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:31.702183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:31.770221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f814f-d45c-44c7-80bc-63159faa32f7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:31.822284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:31.824024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a87d9b-fbf0-466d-882c-5ef708241ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:31.824706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a87d9b-fbf0-466d-882c-5ef708241ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:31.825020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a87d9b-fbf0-466d-882c-5ef708241ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:31.825298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a87d9b-fbf0-466d-882c-5ef708241ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:31.864734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 187/359] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:55:31.870461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:31.926728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a87d9b-fbf0-466d-882c-5ef708241ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:31.928209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a87d9b-fbf0-466d-882c-5ef708241ae0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:31.939819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:32.027897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec34d0-ce23-4079-8d5b-a923865490a3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.044560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 173/360] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:55:32.046239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00006ed9-e53f-43aa-8f3d-9dcadb76c9bd None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.046689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00006ed9-e53f-43aa-8f3d-9dcadb76c9bd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.047107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00006ed9-e53f-43aa-8f3d-9dcadb76c9bd None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.053501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 174/361] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:32.057808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00006ed9-e53f-43aa-8f3d-9dcadb76c9bd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.092464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6578d9-6ba5-4a94-b05d-878bc4f1f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.093413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6578d9-6ba5-4a94-b05d-878bc4f1f358 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.093697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6578d9-6ba5-4a94-b05d-878bc4f1f358 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.094216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6578d9-6ba5-4a94-b05d-878bc4f1f358 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.095616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6578d9-6ba5-4a94-b05d-878bc4f1f358 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:32.097120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6578d9-6ba5-4a94-b05d-878bc4f1f358 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:32.098927 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 188/362] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:31 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:32.104933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268c97-7758-48ad-8acf-eeb8e7066ff0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.105221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268c97-7758-48ad-8acf-eeb8e7066ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.105498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268c97-7758-48ad-8acf-eeb8e7066ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.133619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-00268c97-7758-48ad-8acf-eeb8e7066ff0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:32.135753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00268c97-7758-48ad-8acf-eeb8e7066ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:32.184570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00006ed9-e53f-43aa-8f3d-9dcadb76c9bd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.197969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:32.248884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.248884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.248884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.248884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.250360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:32.258321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:32.261101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:32.265075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 175/363] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:32.267166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.307413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 189/364] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:32.310835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b00a7-0619-43ca-82dc-283ae607ffb4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.311574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b00a7-0619-43ca-82dc-283ae607ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.312243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b00a7-0619-43ca-82dc-283ae607ffb4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.316586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 190/365] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:32.318514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b00a7-0619-43ca-82dc-283ae607ffb4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.449391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1ae04-1340-4ace-bc94-47e4e7c9a0c1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.493172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b00a7-0619-43ca-82dc-283ae607ffb4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.518079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a98acf-8641-4177-a33d-085c4ab856df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.519472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98acf-8641-4177-a33d-085c4ab856df None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.519901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98acf-8641-4177-a33d-085c4ab856df None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.520326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a98acf-8641-4177-a33d-085c4ab856df None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.523209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a98acf-8641-4177-a33d-085c4ab856df None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:32.525794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a98acf-8641-4177-a33d-085c4ab856df None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:32.528822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 176/366] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:32.530945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.531442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.531917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.542756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.544127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.544631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.545137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.546623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:32.548506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:32.550498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 191/367] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:32.551626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.572774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:32.574968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:32.617215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:32.664015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:32.672072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3ff4-89ee-4c41-ad20-423073906cb2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.714666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.715825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.716304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.716899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.719866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 177/368] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:32.721531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.731613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:32.742280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:32.743279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 13:55:32.744076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:32.746656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 192/369] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:32.748674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.874732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd4d7f-f6e5-4d6c-9fcb-538b8a5f33da None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.915668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.916953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.917462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.918002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.919239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=21845fc9a556433e86038123077c8a82) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:32.919428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b634bdf-5fba-4331-8b04-e4100dae924a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:32.920083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:32.922114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:32.931662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 178/370] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:32.932192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:32.933253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:32.960656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:32.961346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:32.961845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:32.962199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:32.963180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=21845fc9a556433e86038123077c8a82) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:32.963577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:32.965904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:32.973346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 193/371] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:32.975518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:33.015117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:33.117826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec66805-5c16-4f18-a982-63af01312662 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:33.133471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d40425-d6d1-42ca-ae66-c4e231896342 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:33.161616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58837301-bd90-4732-b3f7-97ca6123a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:33.162401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58837301-bd90-4732-b3f7-97ca6123a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.162683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58837301-bd90-4732-b3f7-97ca6123a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.162962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58837301-bd90-4732-b3f7-97ca6123a8e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.177324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58837301-bd90-4732-b3f7-97ca6123a8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-58837301-bd90-4732-b3f7-97ca6123a8e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:33.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:33.191657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 194/372] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:33.193617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce0499-2d17-4396-b8d0-0fd0861341b2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.195213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce0499-2d17-4396-b8d0-0fd0861341b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.195213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce0499-2d17-4396-b8d0-0fd0861341b2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.195213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 195/373] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:33.206472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.206915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.207295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.208539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:33.209526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.210108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.210650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.211698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:33.212452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:33.215544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:33.228642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 179/374] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:33.229995 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:33.253088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:33.258522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:33.305282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:33.390651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:33.396481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b54ab-5022-4799-8138-4c2835aa899b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:33.401917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 196/375] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:33.404931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:33.459529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:33.461125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.461871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.462600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.464150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:33.467599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:33.470912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:33.496313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 180/376] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:33.498377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:33.644865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2a2d8-52ad-411b-8be0-43d092b7b8c4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:33.693714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb037b-6653-4151-8899-f121ba24805d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:33.734434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:33.736129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.737830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.741348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] PATH_INFO: `/v3/users/b13d8dec90f54c6ebaf80f3993c4c2a1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.743240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=b13d8dec90f54c6ebaf80f3993c4c2a1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:33.745178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:33.747627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 197/377] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:55:33 2022] GET /identity/v3/users/b13d8dec90f54c6ebaf80f3993c4c2a1 => generated 293 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:33.752970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:33.781921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:33.782892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.783074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.783318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:33.794196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:33.804557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:33.818313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:33.819307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:33.820121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 181/378] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:33.820806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:33.867827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:33.918821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01bcdd-769b-4359-bf16-ec753a3dd7a6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:33.956290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:33.957359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:33.957840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:33.958330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.034394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.036262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.066508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:34.096323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155560e-1d7e-438a-905f-34a0c8996fe8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:34.142212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:34.143280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:34.143758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:34.144229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.145317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] RBAC: Adding query filter params (role.id=992ff3ff2e974a7ca11155a41f5ac10a, user.id=b13d8dec90f54c6ebaf80f3993c4c2a1, scope.system=all) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:34.145845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.147552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.162607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 182/379] 10.222.0.71 () {56 vars in 1308 bytes} [Wed May 18 13:55:33 2022] GET /identity/v3/role_assignments?user.id=b13d8dec90f54c6ebaf80f3993c4c2a1&scope.system=all&role.id=992ff3ff2e974a7ca11155a41f5ac10a => generated 510 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:34.163554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:34.164421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 198/380] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:34.171039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:34.315196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb52062-b236-461e-bab6-9412ce8e92d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:34.349186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:34.365250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:34.366277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:34.366559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:34.366832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] PATH_INFO: `/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.373303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] RBAC: Authorizing `identity:get_project(project_id=cac9ce8241ae4db2ae909b6e0401b3f2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.374813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.379671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 199/381] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:34 2022] GET /identity/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:34.383015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:34.397366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:34.442662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6b358-a3a4-4ac8-8cc9-d628cdf42d3f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:34.523464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:34.524507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:34.525011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:34.525595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.526500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:34.527013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.528500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.541554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 183/382] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:34.547496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:34.568985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca125b9-100b-48c5-9059-6e808589b26a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:34.665486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:34.666376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:34.666659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:34.666928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] PATH_INFO: `/v3/groups/65682e3393eb4ef7b44e1e0edc292558` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.681808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] RBAC: Authorizing `identity:get_group(group_id=65682e3393eb4ef7b44e1e0edc292558)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.684490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.688843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 200/383] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:34 2022] GET /identity/v3/groups/65682e3393eb4ef7b44e1e0edc292558 => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:34.701230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:34.731254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24a52-9373-4550-bf04-3d08cfc936e5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:34.815195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:34.845668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:34.846819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:34.847114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:34.847399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.848872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.850371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.851680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a7f85-c3c4-4a93-80c5-4b8252920a97 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:34.852450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 184/384] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:34 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:34.877897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:34.896665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:34.906370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:34.907977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:34.908390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:34.908670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:34.909568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] RBAC: Adding query filter params (group.id=65682e3393eb4ef7b44e1e0edc292558, role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=cac9ce8241ae4db2ae909b6e0401b3f2) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:34.910141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:34.911592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bbba2-04a4-4b12-816a-ff6971865c8e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:34.918740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 201/385] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:34 2022] GET /identity/v3/role_assignments?group.id=65682e3393eb4ef7b44e1e0edc292558&scope.project.id=cac9ce8241ae4db2ae909b6e0401b3f2&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:35.035063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bebc24-bd19-437e-b085-eff295b1b13a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:35.064225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270acbee-bcc9-4ad2-a41d-0baa033e7bf2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:35.064593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270acbee-bcc9-4ad2-a41d-0baa033e7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:35.064760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270acbee-bcc9-4ad2-a41d-0baa033e7bf2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:35.066411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 202/386] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:35.073344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:35.074006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:35.074501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:35.103998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:35.105609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:35.117817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:35.124293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:35.124606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:35.124941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:35.127342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:35.128984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:35.131270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 185/387] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:34 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:35.157029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:35.284709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 203/388] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:35.326306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:35.424097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:35.443878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:35.501943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f211-1ab3-4247-bd35-786b6bdf44cc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:35.554598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c63322-fe4b-4859-b428-62be56dd778d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:35.614487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:35.615175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:35.615465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:35.615811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:35.618275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3cbbf04054e2fb4f841d3f285788d, group_id=1a70ea76bbfb4c7db21cc2dee38724fa, role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:35.619827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:35.631064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:35.633711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:35.637664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:35.638377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:35.664678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:35.681447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:35.683213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:35.685566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:35.690635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 204/389] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:35.697377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:35.724775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 186/390] 10.222.0.71 () {58 vars in 1442 bytes} [Wed May 18 13:55:35 2022] PUT /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:55:35.936827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579fd2b-d44c-46c4-ac1c-1588e7fbc151 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:35.961730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:36.006094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:36.007327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.007813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.008298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.009747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:36.010205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:36.012820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:36.030526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 205/391] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:36.038458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:36.209941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef862-8493-4408-8c8c-7b74a44362bb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:36.255778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:36.256666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.257000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.257276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.258508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:36.260044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:36.262069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 187/392] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:36 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:36.269186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:36.488534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417eab6-2fac-410d-b693-22071fa5f1fe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:36.541780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b904243-07e0-4707-8024-d1af5bdd7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:36.543079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904243-07e0-4707-8024-d1af5bdd7278 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.543601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904243-07e0-4707-8024-d1af5bdd7278 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.544110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904243-07e0-4707-8024-d1af5bdd7278 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.545837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b904243-07e0-4707-8024-d1af5bdd7278 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:36.547868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b904243-07e0-4707-8024-d1af5bdd7278 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:36.550257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 206/393] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:36 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:36.556362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:36.571963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:36.721579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82b801-27f5-4bce-9a3a-122e63d5a41e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:36.774352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f82db-68ef-479d-b442-e25d8f7db2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:36.775182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f82db-68ef-479d-b442-e25d8f7db2c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.775467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f82db-68ef-479d-b442-e25d8f7db2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.775746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f82db-68ef-479d-b442-e25d8f7db2c1 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.777917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f82db-68ef-479d-b442-e25d8f7db2c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3cbbf04054e2fb4f841d3f285788d, group_id=1a70ea76bbfb4c7db21cc2dee38724fa, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:36.779411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f82db-68ef-479d-b442-e25d8f7db2c1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:36.863043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 188/394] 10.222.0.71 () {58 vars in 1442 bytes} [Wed May 18 13:55:36 2022] PUT /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:36.872763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc31fe-4c8b-422f-9a5d-c27392c8f135 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.873373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc31fe-4c8b-422f-9a5d-c27392c8f135 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.873758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc31fe-4c8b-422f-9a5d-c27392c8f135 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.879194 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 207/395] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:36.887742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.888439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.888947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.915833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:36.921672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:36.943480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371fee-8f8b-4dbb-be79-e0b7c1be6f70 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.944023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371fee-8f8b-4dbb-be79-e0b7c1be6f70 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.944515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c371fee-8f8b-4dbb-be79-e0b7c1be6f70 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.947168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 208/396] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:36.954891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:36.955383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:36.955868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:36.992676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:36.995154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:37.060140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:37.072885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 189/397] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:37.081771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:37.117881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:37.147270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 209/398] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:37.177613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:37.278049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ce3de-732f-4f2c-a8fd-a90a6ccfc382 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:37.330341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:37.331708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:37.332213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:37.332713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:37.358767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:37.376831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:37.377899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:37.378706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:37.379377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 190/399] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:37.392113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:37.461922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e2add-e119-44a0-a758-86e8c71df33b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:37.564776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:37.570788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:37.572928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:37.573766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:37.574647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:37.622764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:37.642062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:37.643928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:37.645530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:37.648396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b48be5-d299-400a-b8e3-669a87fda156 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:37.651775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 210/400] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:37.658787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:37.717611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:37.718302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:37.718585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:37.718886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:37.724828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:37.724828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:37.724828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:37.736006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 191/401] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:37.744163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:37.760516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:37.894466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d65661-d93d-43f4-abfc-a8dbdb73eb7b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:37.966947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:37.971539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:37.972452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:37.973254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:37.975182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:37.976224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:37.980708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:38.008195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 211/402] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:38.018873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:38.087646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843e4f-df46-45f4-8ba5-32dd5da449d1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:38.143554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:38.181666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:38.182549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.182873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.183157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.185571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:38.187093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:38.190398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 192/403] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:37 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:38.207402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:38.269115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:38.287606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d178-2993-46d3-8692-c9f84ab72b2e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:38.360300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:38.361853 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.362341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.362842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.365250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:38.368010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:38.386278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 212/404] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:38 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:38.394584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:38.417660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5cee1-2fa4-46b1-bcb4-947d3c7635b0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:38.487687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:38.488947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.489378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.489793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.491875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:38.494219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:38.502083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 193/405] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:38 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:38.503674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:38.611987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:38.642586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba10813-b246-483c-8c71-5ecad3854180 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:38.666127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949181-10cd-40cc-8f32-772b9df179ec None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:38.692274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa64e2-b538-4835-90e5-45b68f86e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:38.693621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa64e2-b538-4835-90e5-45b68f86e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.694109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa64e2-b538-4835-90e5-45b68f86e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.694630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa64e2-b538-4835-90e5-45b68f86e6c0 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.696283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa64e2-b538-4835-90e5-45b68f86e6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:38.698144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa64e2-b538-4835-90e5-45b68f86e6c0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:38.700686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 213/406] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:38 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:38.702373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f95a0-a9bb-402c-90af-d851cb04ef57 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.702861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f95a0-a9bb-402c-90af-d851cb04ef57 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.703459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f95a0-a9bb-402c-90af-d851cb04ef57 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.705191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 214/407] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:38.710578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f95a0-a9bb-402c-90af-d851cb04ef57 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:38.712730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c79409-bea1-4cf3-a94c-9ce6324d5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:38.713653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79409-bea1-4cf3-a94c-9ce6324d5123 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.714176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79409-bea1-4cf3-a94c-9ce6324d5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.714349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c79409-bea1-4cf3-a94c-9ce6324d5123 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.716499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c79409-bea1-4cf3-a94c-9ce6324d5123 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845fc9a556433e86038123077c8a82, group_id=1a70ea76bbfb4c7db21cc2dee38724fa, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:38.718068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c79409-bea1-4cf3-a94c-9ce6324d5123 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:38.743645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:38.851643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 194/408] 10.222.0.71 () {58 vars in 1442 bytes} [Wed May 18 13:55:38 2022] PUT /identity/v3/projects/21845fc9a556433e86038123077c8a82/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:38.854589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:38.855465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:38.857070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:38.892043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:38.892557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f95a0-a9bb-402c-90af-d851cb04ef57 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:38.894880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:39.003914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:39.005486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.005954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.006421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.017934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] RBAC: Authorizing `identity:create_grant(project_id=21845fc9a556433e86038123077c8a82, group_id=1a70ea76bbfb4c7db21cc2dee38724fa, role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:39.020470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:39.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 195/409] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:39.075324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:39.107218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 215/410] 10.222.0.71 () {58 vars in 1442 bytes} [Wed May 18 13:55:38 2022] PUT /identity/v3/projects/21845fc9a556433e86038123077c8a82/groups/1a70ea76bbfb4c7db21cc2dee38724fa/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:55:39.206536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:39.345337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175091ad-5fd0-4ff2-b247-8989c71cf478 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:39.414469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682cdf4-fab1-4b9b-bb1d-790e5bed15b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:39.416547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682cdf4-fab1-4b9b-bb1d-790e5bed15b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.417321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682cdf4-fab1-4b9b-bb1d-790e5bed15b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.417978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682cdf4-fab1-4b9b-bb1d-790e5bed15b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.440140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682cdf4-fab1-4b9b-bb1d-790e5bed15b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b682cdf4-fab1-4b9b-bb1d-790e5bed15b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:39.455314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:39.457178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:39.458797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:39.468830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 196/411] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:55:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:39.471156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:39.608289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:39.619302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e333e6-10b9-434f-a9c8-9a78ecf7d7bd None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.621483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e333e6-10b9-434f-a9c8-9a78ecf7d7bd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.621483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e333e6-10b9-434f-a9c8-9a78ecf7d7bd None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.626757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 197/412] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:55:39.629089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283795bd-e479-4d76-b928-bc747e792540 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:39.629240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29d4e6-0dd8-4a23-95a7-1589d1fa3f13 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.629755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29d4e6-0dd8-4a23-95a7-1589d1fa3f13 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.630230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29d4e6-0dd8-4a23-95a7-1589d1fa3f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.652500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4f29d4e6-0dd8-4a23-95a7-1589d1fa3f13 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:39.654629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4f29d4e6-0dd8-4a23-95a7-1589d1fa3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:39.711810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:39.714108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.714582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.715263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.717008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:39.717752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:39.719967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:39.739821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 216/413] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:39.745804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:39.808816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 198/414] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:39.851125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6051-a06c-4415-96e9-c7002d0f496c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.851613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6051-a06c-4415-96e9-c7002d0f496c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.852008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a6051-a06c-4415-96e9-c7002d0f496c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.857506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 199/415] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:39.861409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6051-a06c-4415-96e9-c7002d0f496c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:39.919526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d80895-9c39-40d2-a84b-77d7dbfdd661 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:39.928981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:39.986097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d054-c324-4ef2-9112-670c4dbae4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:39.987485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d054-c324-4ef2-9112-670c4dbae4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.987825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d054-c324-4ef2-9112-670c4dbae4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.988305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d054-c324-4ef2-9112-670c4dbae4a9 None admin] PATH_INFO: `/v3/groups/65682e3393eb4ef7b44e1e0edc292558` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:39.990592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d054-c324-4ef2-9112-670c4dbae4a9 None admin] RBAC: Authorizing `identity:get_group(group_id=65682e3393eb4ef7b44e1e0edc292558)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:39.993342 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76d054-c324-4ef2-9112-670c4dbae4a9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:39.996467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 217/416] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:39 2022] GET /identity/v3/groups/65682e3393eb4ef7b44e1e0edc292558 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:39.998840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:39.999028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:39.999510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:40.032476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:40.034589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:40.051267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a6051-a06c-4415-96e9-c7002d0f496c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:40.060332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:40.130671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:40.133479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:40.134263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:40.135019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:40.161839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:40.169862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 218/417] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:40.173326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:40.180589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:40.182840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:40.184418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:40.189359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 200/418] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:40.191138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:40.429577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:40.430554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d7c8-bfaa-458b-988e-ffb6cb395000 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:40.444311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bf951-5108-4eb5-b8e6-aefa73706fc0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:40.516567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:40.518594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:40.519378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:40.520132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:40.521924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:40.522781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:40.524878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:40.525977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:40.526358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:40.526863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:40.527356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] PATH_INFO: `/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:40.530686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] RBAC: Authorizing `identity:get_project(project_id=cac9ce8241ae4db2ae909b6e0401b3f2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:40.535503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:40.544834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 219/419] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:40 2022] GET /identity/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2 => generated 344 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:40.544834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:40.550765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 201/420] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:40.552527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:40.586484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:40.764097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847d8ea-7a23-4562-9ea7-6eb8ab5b3aef None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:40.807034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7c8fc-0a0c-4c72-9e83-c31b438f066f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:40.845580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:40.846974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:40.847467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:40.847960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:40.874709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:40.877592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:40.879639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:40.880405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:40.881179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] PATH_INFO: `/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2/groups/65682e3393eb4ef7b44e1e0edc292558/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:40.885145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] RBAC: Authorizing `identity:create_grant(project_id=cac9ce8241ae4db2ae909b6e0401b3f2, group_id=65682e3393eb4ef7b44e1e0edc292558, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:40.888106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:40.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:40.894089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:40.895644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 220/421] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:40.900979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:41.013805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 202/422] 10.222.0.71 () {58 vars in 1442 bytes} [Wed May 18 13:55:40 2022] PUT /identity/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2/groups/65682e3393eb4ef7b44e1e0edc292558/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:55:41.016905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:41.092112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:41.109280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:41.197397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd168e-2304-4e1f-8cb1-e2aaf832a675 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:41.323044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:41.324236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:41.324818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:41.325401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:41.398093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521d57f-8821-4ce9-83bc-9a90b910eb08 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:41.468822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:41.468822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:41.468822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:41.468822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:41.470296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:41.470296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:41.470296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:41.485525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 203/423] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:41.496956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:41.505936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:41.508105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:41.677546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:41.698925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:41.718341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0dcb2-b70a-491d-b2e7-7f447343c1e0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:41.782942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 221/424] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 888 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:41.791968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:41.837590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872be70f-02cd-433a-ae82-eace65757487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:41.838713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872be70f-02cd-433a-ae82-eace65757487 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:41.839213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872be70f-02cd-433a-ae82-eace65757487 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:41.839723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872be70f-02cd-433a-ae82-eace65757487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:41.968517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872be70f-02cd-433a-ae82-eace65757487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:41.971699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872be70f-02cd-433a-ae82-eace65757487 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:42.070219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252bcf-c1d8-4f57-90b3-57157598d288 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:42.098770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:42.128067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0c24d-3528-4edc-a4e3-64ea0883c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:42.129543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c24d-3528-4edc-a4e3-64ea0883c644 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.129900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c24d-3528-4edc-a4e3-64ea0883c644 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.130247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0c24d-3528-4edc-a4e3-64ea0883c644 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.131967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c24d-3528-4edc-a4e3-64ea0883c644 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:42.133737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0c24d-3528-4edc-a4e3-64ea0883c644 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:42.136586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 222/425] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:41 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:42.138409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a505a-dfb6-4439-b2a0-eafd615ea119 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.138696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a505a-dfb6-4439-b2a0-eafd615ea119 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.138973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a505a-dfb6-4439-b2a0-eafd615ea119 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.141474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 223/426] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:42.145954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a505a-dfb6-4439-b2a0-eafd615ea119 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:42.154543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 204/427] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:42.157856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.159318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.159883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.197934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:42.200980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:42.208633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:42.281985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a505a-dfb6-4439-b2a0-eafd615ea119 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:42.324165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:42.325451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.325926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.326417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.328592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:42.330643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:42.333023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 224/428] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:42.334074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:42.360484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 205/429] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:42.362292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:42.450787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9bba-8ccd-45b5-97a6-b63e64ea4495 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:42.466398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:42.491433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:42.493631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.493782 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.494172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] PATH_INFO: `/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.496406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d3cbbf04054e2fb4f841d3f285788d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:42.499261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:42.503493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 225/430] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/projects/d1d3cbbf04054e2fb4f841d3f285788d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:42.505329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:42.535639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268390e-5e65-4105-9ae4-3b4d9364cfe6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:42.552165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:42.606150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:42.607872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.608659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.609985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.611767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:42.612544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:42.616194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:42.630958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 206/431] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:42.633342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:42.709424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c5794-a020-4090-8d70-e973a357a7c4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:42.775802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:42.777217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.778311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.778311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.799338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:42.815288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:42.817122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:42.818683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 226/432] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:42.828564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:42.868039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893229e-8436-4582-9943-3e4c7833412b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:42.938555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:42.954992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:42.962684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:42.962684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:42.962684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:42.970805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:42.973717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:42.977510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 207/433] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:42.987179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:43.075163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd8fe8-6c47-4bac-a339-85e33ba12d40 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:43.150796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:43.162344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:43.163663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:43.165072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:43.165647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:43.167072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:43.167671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:43.170242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:43.197139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 227/434] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:43.203247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:43.321301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9125b-dfda-4d7c-bd3e-833c646c625f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:43.401609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:43.402885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:43.403363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:43.405400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:43.407012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:43.407485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:43.409259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b83817-1915-4eaa-b2a1-f703a6c57b46 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:43.422444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 208/435] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:42 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=d1d3cbbf04054e2fb4f841d3f285788d&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 611 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:43.425203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55686e8-bf02-423f-8162-8d141a6f023b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:43.425667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55686e8-bf02-423f-8162-8d141a6f023b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:43.426150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55686e8-bf02-423f-8162-8d141a6f023b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:43.432820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 209/436] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:43.440105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:43.440574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:43.441091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:43.457825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adfd57-8c85-4016-962d-4bdf2067ec3f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:43.461460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:43.472211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:43.474460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:43.513099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:43.513781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:43.514064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:43.514340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:43.605840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:43.607379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:43.621581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 210/437] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:43.658032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:43.732445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:43.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 228/438] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:55:43.779052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:43.785458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:43.855245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909bf80-eb88-448f-a86b-d811a9226525 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:43.910811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:43.911547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:43.911826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:43.912413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:43.926627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:43.935549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:43.937930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 13:55:43.939446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:43.944846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 211/439] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:43.944846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:43.987529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a9466-67e6-4665-8d80-511bc6a5e471 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.063133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.064706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.065200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.065629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.067959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:44.070114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:44.072577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 229/440] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:43 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:44.080976 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:44.132978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:44.149621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46bf3c-4075-4774-b9fa-e424b862fc78 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.196754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:44.206646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.207340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.207623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.207900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.209018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:44.209325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:44.210762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe42d3-c9e7-4a37-a841-49d39281907c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:44.221410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 212/441] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:55:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:44.228372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a900a-23cf-4f6b-b125-1c3af76dd7dc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.228372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a900a-23cf-4f6b-b125-1c3af76dd7dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.228372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a900a-23cf-4f6b-b125-1c3af76dd7dc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.228372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 213/442] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:44.230285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a900a-23cf-4f6b-b125-1c3af76dd7dc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:44.253019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a974d-e234-434e-b4ef-4a7101aebabd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.297981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b817-3fd1-4861-b6c9-e826b8cf05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.299278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b817-3fd1-4861-b6c9-e826b8cf05d3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.299628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b817-3fd1-4861-b6c9-e826b8cf05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.300045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b817-3fd1-4861-b6c9-e826b8cf05d3 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.301562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b817-3fd1-4861-b6c9-e826b8cf05d3 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:44.303375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b817-3fd1-4861-b6c9-e826b8cf05d3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:44.305511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 230/443] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:44.307205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.307633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.308105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.328643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:44.330307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:44.361482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a900a-23cf-4f6b-b125-1c3af76dd7dc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.411433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.412295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.412712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.413204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.420190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 231/444] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:44.421103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:44.445335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:44.496442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:44.497854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:44.519627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:44.561619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f73eb4-399b-4521-ba64-4fbde5d4f621 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.603520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.604200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.604472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.604764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.605639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=21845fc9a556433e86038123077c8a82) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:44.605948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:44.607448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:44.614544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 232/445] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:44.615404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:44.633591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 214/446] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:55:44.639461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:44.713601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:44.772103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ec75c-dee7-42c8-96e3-a565c26c506b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.779592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6e792-a830-43e6-b032-cb6f90868323 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:44.813765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:44.820027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.820969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.821353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.821781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.828490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:44.829754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:44.830057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:44.830350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] PATH_INFO: `/v3/projects/21845fc9a556433e86038123077c8a82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:44.831823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] RBAC: Authorizing `identity:get_project(project_id=21845fc9a556433e86038123077c8a82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:44.833412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:44.835604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 215/447] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/projects/21845fc9a556433e86038123077c8a82 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:44.837042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:44.846016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:44.847013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:55:44.847989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:44.848753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:44.855151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 233/448] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:44.856390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:45.006401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c812-6be0-4619-96bc-2af33bb4cd37 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:45.025950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f543e-61c2-4c44-9f66-a852641d4336 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:45.048847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:45.049629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:45.050016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:45.050427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:45.051258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:45.051713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:45.052674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:45.053692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:45.064369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 234/449] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:45.070464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:45.072378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:45.073485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:45.073893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:45.074280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] PATH_INFO: `/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:45.075830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] RBAC: Authorizing `identity:get_group(group_id=1a70ea76bbfb4c7db21cc2dee38724fa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:45.079760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:45.082911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 216/450] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:44 2022] GET /identity/v3/groups/1a70ea76bbfb4c7db21cc2dee38724fa => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:45.092167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:45.168759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:45.240737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701321-723c-4706-a9ef-0ad512bb20a8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:45.243661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1882a-54d8-42da-8a64-fbde16727a05 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:45.288905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:45.289458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:45.289729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:45.290000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:45.290825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] RBAC: Adding query filter params (group.id=1a70ea76bbfb4c7db21cc2dee38724fa, role.id=fdc0b94e97b748159f3e6d678394e34e, scope.project.id=21845fc9a556433e86038123077c8a82) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:45.291132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:45.291969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:45.292586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:45.293115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:45.293625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:45.294104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:45.299633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 217/451] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:45 2022] GET /identity/v3/role_assignments?group.id=1a70ea76bbfb4c7db21cc2dee38724fa&scope.project.id=21845fc9a556433e86038123077c8a82&role.id=fdc0b94e97b748159f3e6d678394e34e => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:55:45.441271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:45.444178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:45.537023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:45.613614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 235/452] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 13:55:45.620977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:45.707098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:45.777697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0e40-98ff-425b-914a-c98e36015e9f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:45.822122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:45.823001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:45.823279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:45.823551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] PATH_INFO: `/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:45.824857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] RBAC: Authorizing `identity:get_project(project_id=cac9ce8241ae4db2ae909b6e0401b3f2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:45.826362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:45.828441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 218/453] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:55:45 2022] GET /identity/v3/projects/cac9ce8241ae4db2ae909b6e0401b3f2 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:45.837468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:45.964951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c00106-436b-4b7b-a356-6fa2c8023f9b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:46.000919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0fa9-8eb9-4081-a1b5-f0cf41f18d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:46.001789 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0fa9-8eb9-4081-a1b5-f0cf41f18d1c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:46.002065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0fa9-8eb9-4081-a1b5-f0cf41f18d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:46.002334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0fa9-8eb9-4081-a1b5-f0cf41f18d1c None admin] PATH_INFO: `/v3/groups/65682e3393eb4ef7b44e1e0edc292558` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:46.003605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0fa9-8eb9-4081-a1b5-f0cf41f18d1c None admin] RBAC: Authorizing `identity:get_group(group_id=65682e3393eb4ef7b44e1e0edc292558)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:46.005082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0fa9-8eb9-4081-a1b5-f0cf41f18d1c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:46.006759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 236/454] 10.222.0.71 () {56 vars in 1180 bytes} [Wed May 18 13:55:45 2022] GET /identity/v3/groups/65682e3393eb4ef7b44e1e0edc292558 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:46.012731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:46.118757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035615c2-f1a3-4021-a759-7c94163e5258 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:46.145896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:46.158360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:46.159512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:46.159512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:46.159808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:46.160696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] RBAC: Adding query filter params (group.id=65682e3393eb4ef7b44e1e0edc292558, role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=cac9ce8241ae4db2ae909b6e0401b3f2) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:46.161130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:46.162651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7874b-3da5-4707-97e5-c1abcd62c2c4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:46.169174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 219/455] 10.222.0.71 () {56 vars in 1376 bytes} [Wed May 18 13:55:46 2022] GET /identity/v3/role_assignments?group.id=65682e3393eb4ef7b44e1e0edc292558&scope.project.id=cac9ce8241ae4db2ae909b6e0401b3f2&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:49.355169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272845-e2ba-4d51-8c89-d5ceda1fbb6e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:49.356727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272845-e2ba-4d51-8c89-d5ceda1fbb6e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:49.357538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66272845-e2ba-4d51-8c89-d5ceda1fbb6e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:49.360982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 237/456] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:49.369990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:49.370769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:49.370899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:49.414678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:49.416819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:49.544178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 220/457] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:49.626400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66272845-e2ba-4d51-8c89-d5ceda1fbb6e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:49.664552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:49.790600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66272845-e2ba-4d51-8c89-d5ceda1fbb6e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:49.846540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:49.847249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:49.847534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:49.847807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:49.865666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:49.867169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e5b0b8c4-c1c5-4c3c-86ea-8d265b3bd59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:49.909815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:49.911509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:49.913221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:49.913221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:49.913221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:49.913221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:49.916738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 238/458] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:49.925831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:50.102258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675e677-2745-4f5a-ace9-73f0641360e6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.103224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675e677-2745-4f5a-ace9-73f0641360e6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.103963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675e677-2745-4f5a-ace9-73f0641360e6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.112327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 239/459] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:50.119337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c70a6c-8cae-434a-b71a-13e8ef174699 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.119830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c70a6c-8cae-434a-b71a-13e8ef174699 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.120325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c70a6c-8cae-434a-b71a-13e8ef174699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.128897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c776a6b-dc14-4c7a-bb4d-860fd3bcd8a5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:50.150853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:50.163160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34c70a6c-8cae-434a-b71a-13e8ef174699 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:50.164428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34c70a6c-8cae-434a-b71a-13e8ef174699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:50.183485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:50.184274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.184554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.184859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.185592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:50.185897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:50.187620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:50.223528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 221/460] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:50.244385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:50.357957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 240/461] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:50.361020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896d576-45b8-44bc-88b6-4774d35f91cc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.361522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896d576-45b8-44bc-88b6-4774d35f91cc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.362004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896d576-45b8-44bc-88b6-4774d35f91cc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.371661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 241/462] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:50.374097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.375239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.375714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.387389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:50.408141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:50.410313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:50.491068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0560cbc-44cc-4f9e-bcbe-69fa0d8500a8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:50.553501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 242/463] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:50.556044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:50.569856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:50.571419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.576202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.576741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.578186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:50.580752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:50.718844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 222/464] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:50 2022] POST /identity/v3/users => generated 246 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:50.721247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:50.846989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944cee0-b3da-4b7e-8bce-d463ea7bacd7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:50.857519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:50.929829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:50.931818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:50.932681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:50.933793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:50.938608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:50.959564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:50.963555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:51.003827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:51.005477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:51.007145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:51.007145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:51.007145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:51.007145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:51.010812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 243/465] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:51.018828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:51.099271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b0c2-bf4d-4654-b8b0-6b090e716c63 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:51.189329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:51.190165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.190450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.190729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.204476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:51.206134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bebc2f4b-775f-4cdf-a8de-cbfae9f7b0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:51.233404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:51.234907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:51.235760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:51.235760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:51.235760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:51.235760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:51.235986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 223/466] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:51.237456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de575-f311-4912-8b6c-c2999318f3dc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.237736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de575-f311-4912-8b6c-c2999318f3dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.238013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830de575-f311-4912-8b6c-c2999318f3dc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.239861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 224/467] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:51.246262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22584d-517b-4c41-8448-10b91086231b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.246547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22584d-517b-4c41-8448-10b91086231b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.246824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22584d-517b-4c41-8448-10b91086231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.269682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f22584d-517b-4c41-8448-10b91086231b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:51.270873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f22584d-517b-4c41-8448-10b91086231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:51.279853 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5d203-43d3-4be3-adca-0a7797b60589 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:51.342963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:51.343756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.344092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.344438 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.345294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:51.345603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:51.347096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:51.364149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 244/468] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:51.369377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:51.418093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 225/469] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:51.419439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22584d-517b-4c41-8448-10b91086231b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:51.445744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:51.457040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:51.556828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a544f9-852e-453f-8927-0c60f2fc6e8c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:51.589655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22584d-517b-4c41-8448-10b91086231b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:51.626262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:51.626945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.627225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.627498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.628238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:51.628547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:51.630333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:51.646168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 245/470] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:51.647151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:51.656820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:51.656820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.656820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.656820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.657610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:51.659038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:51.753128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 226/471] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:51 2022] POST /identity/v3/users => generated 248 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:51.754785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:51.901984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d545bf-b700-4d7b-9eb3-b812dea97773 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:51.920820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:51.957521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:51.958779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:51.959388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:51.959899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:51.975159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:51.982180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:51.984250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:52.008938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:52.009873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:52.010716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:52.010716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:52.010716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:52.010716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:52.013370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 246/472] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:52.020072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:52.064844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be1375-7561-4f19-88cc-23526ce224f5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:52.128413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec5a9b-de48-4257-8e1c-f29e833bee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:52.129759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5a9b-de48-4257-8e1c-f29e833bee4e None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:52.130246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5a9b-de48-4257-8e1c-f29e833bee4e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:52.130723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec5a9b-de48-4257-8e1c-f29e833bee4e None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:52.132030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec5a9b-de48-4257-8e1c-f29e833bee4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:52.135261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec5a9b-de48-4257-8e1c-f29e833bee4e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:52.192304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393af8-e3c1-42f4-9fb7-dba53e78d75b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:52.243655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:52.244329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:52.244686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:52.245124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:52.245869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:52.246170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:52.247656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab904ba-e169-4089-a47d-1b32044dfca9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:52.263531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 247/473] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:52.264649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005390b5-9d3f-4e62-8dc8-51673df6a543 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:52.265023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005390b5-9d3f-4e62-8dc8-51673df6a543 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:52.265837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005390b5-9d3f-4e62-8dc8-51673df6a543 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:52.272097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 248/474] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:52.273754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005390b5-9d3f-4e62-8dc8-51673df6a543 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:52.278653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 227/475] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:51 2022] POST /identity/v3/users => generated 248 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:52.286583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:52.286949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:52.288123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:52.303961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:52.330237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:52.331681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:52.505793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005390b5-9d3f-4e62-8dc8-51673df6a543 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:52.517151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 228/476] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:55:52.557053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:52.570335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:52.571027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:52.571309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:52.571582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:52.572302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:52.573821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:52.648445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:52.680107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 249/477] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:52 2022] POST /identity/v3/users => generated 249 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:52.751627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840e3e-b26e-4cb7-ad17-a034ede27669 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:52.818557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:52.819159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:52.819437 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:52.819711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:52.820476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:52.821921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:52.871531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.sql.core [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 13:55:52.871531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 13:55:52.871531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [parameters: {'id': '9e9e1050793c444ba2b05cfd106b7c4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 13:55:52.871531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80330) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() May 18 13:55:52.897616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return ref.to_dict() May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 13:55:52.898562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application yield resource May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.rollback() May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.force_reraise() May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise self.value May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application session.commit() May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 13:55:52.899895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._prepare_impl() May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.flush() May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._flush(objects) May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application compat.raise_( May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application flush_context.execute() May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rec.execute(self) May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 13:55:52.900848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 13:55:52.902089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 13:55:52.903449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [parameters: {'id': '9e9e1050793c444ba2b05cfd106b7c4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:52.904460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 13:55:52.909537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:52.910582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 229/478] 10.222.0.71 () {60 vars in 1131 bytes} [Wed May 18 13:55:52 2022] POST /identity/v3/roles => generated 144 bytes in 343 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:52.914941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:53.026051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:53.056331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e90d7-aa0b-4f8e-8b43-04276ca6df5f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:53.106168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73822b72-ba88-4598-bce4-e11a78494a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:53.107304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822b72-ba88-4598-bce4-e11a78494a1e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:53.107754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822b72-ba88-4598-bce4-e11a78494a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:53.108166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822b72-ba88-4598-bce4-e11a78494a1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:53.126016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73822b72-ba88-4598-bce4-e11a78494a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-73822b72-ba88-4598-bce4-e11a78494a1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:53.134758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:53.135886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 13:55:53.136803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:53.139278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 250/479] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:55:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:53.147676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:53.285163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8970a3b-b3b9-4f2e-9b8e-8588042d1e1d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:53.321275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:53.325506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:53.326083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:53.326375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:53.326928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:53.328095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:53.328659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:53.330156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3c4ee-cb60-4a73-89bd-253f4739ac1c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:53.340099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 230/480] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:53.824465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7a61-feda-4cd0-b88d-917b8ff474ce None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:53.825514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7a61-feda-4cd0-b88d-917b8ff474ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:53.825993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7a61-feda-4cd0-b88d-917b8ff474ce None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:53.828029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 251/481] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:53.833441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:53.834298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:53.834782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:53.855369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:53.856977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:53.943949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 231/482] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:53.982112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7a61-feda-4cd0-b88d-917b8ff474ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:54.148613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7a61-feda-4cd0-b88d-917b8ff474ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:54.204225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:54.205024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:54.205308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:54.205584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:54.208325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:54.224520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:54.232525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:54.234928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:54.235941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:54.241171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 252/483] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:55:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:54.242178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:54.454733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed52daa-8403-4db8-aa61-df04903320b3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:54.481330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:54.518532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:54.519238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:54.519536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:54.519799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:54.520563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:54.520898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:54.522329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:54.544320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 232/484] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:55:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:54.550618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:54.715674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4eec7-e8f5-4569-8def-d7a64373f4ed None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:54.765485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:54.766631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:54.767062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:54.767345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:54.788643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:54.792267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:54.816389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:54.817341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:54.818192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:54.818192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:54.818192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:54.818192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:54.825149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 253/485] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:54.827028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:55.119826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d453a-2f02-4ab1-b9f0-102fcb19cc1d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:55.190772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:55.191901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:55.192392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:55.192801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:55.194248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:55.194821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:55.197650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:55.232027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 233/486] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:55.241052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:55.373559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:55.440537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e6da-4dcd-4ac3-b426-724486028904 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:55.486971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:55.488164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:55.488639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:55.489126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:55.501633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:55.503437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0b050478-206e-4ac2-8caa-57ef83f7828d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:55:55.531952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:55.533088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:55:55.533982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:55.536845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 254/487] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:55:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:55.546689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:55.558513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e62fe5-51a5-411e-b45c-d5d8da76e381 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:55.559319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e62fe5-51a5-411e-b45c-d5d8da76e381 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:55.559792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e62fe5-51a5-411e-b45c-d5d8da76e381 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:55.561478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 255/488] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:55.575325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:55.575923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:55.576386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:55.606026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:55.607272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:55.635170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:55.768582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bea1b-594e-4cea-a28d-81492881c0fd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:55.819390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 256/489] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:55.885863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:55.888251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:55.889473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:55.890544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:55.891048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:55.893055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:55.893597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:55.896479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:55.929961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:55.980146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 234/490] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:55:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:55.988716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:56.080542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5597aa0-fa13-4b3e-ba0c-e3eb42d2342c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:56.143504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:56.144642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513e479-a762-432f-bc26-8f4b53bd63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:56.146090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513e479-a762-432f-bc26-8f4b53bd63a2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.146582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513e479-a762-432f-bc26-8f4b53bd63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.147072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513e479-a762-432f-bc26-8f4b53bd63a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.151196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face2d3d-227d-4524-abdf-9a3485ad7b0c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:56.166830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513e479-a762-432f-bc26-8f4b53bd63a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7513e479-a762-432f-bc26-8f4b53bd63a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:56.183102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:56.184678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:56.185695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 257/491] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:55:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:55:56.190153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668dbc-9336-4964-90b8-3a84d63033ff None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.190153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668dbc-9336-4964-90b8-3a84d63033ff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.190622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668dbc-9336-4964-90b8-3a84d63033ff None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.193798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 258/492] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:56.195725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa18b0a-c081-451c-a034-52072bb0614f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.196020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa18b0a-c081-451c-a034-52072bb0614f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.196306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa18b0a-c081-451c-a034-52072bb0614f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.198029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 259/493] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:56.202432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa18b0a-c081-451c-a034-52072bb0614f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:56.205741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22d6f5-c7d0-47ac-ad55-de50b4e9d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:56.206431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22d6f5-c7d0-47ac-ad55-de50b4e9d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.206718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22d6f5-c7d0-47ac-ad55-de50b4e9d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.207000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22d6f5-c7d0-47ac-ad55-de50b4e9d6e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.290661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22d6f5-c7d0-47ac-ad55-de50b4e9d6e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:56.292223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22d6f5-c7d0-47ac-ad55-de50b4e9d6e1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:56.353632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:56.364253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa18b0a-c081-451c-a034-52072bb0614f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:56.423358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:56.424335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.424671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.425102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.426091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:56.426571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:56.427234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:56.428600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c0b0f-d561-4244-9a43-c871f4db2845 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:56.437564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 235/494] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:56.443227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.443227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.443227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.444562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 260/495] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:55:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:56.450649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.451127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.451420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.462923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:56.464170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:56.471658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:56.472951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:56.556744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 236/496] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:56.557756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:56.577064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 261/497] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:56.579267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:56.691077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bb559-6038-4b3e-8150-567c1d2aedc1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:56.727413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:56.727797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:56.742883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661dfd0-7ca3-4bc8-ad37-97fbbf4e588f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:56.744834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:56.745646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.745928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.746205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.758055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:56.760493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:56.791588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:56.792907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.801666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.801666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e3ddf622-70d1-4d2b-a10c-b08c2b376733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:56.801888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:56.802788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 237/498] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86e93-1ab8-4139-b04f-f86421e75a15 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86e93-1ab8-4139-b04f-f86421e75a15 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86e93-1ab8-4139-b04f-f86421e75a15 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:56.803635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 238/499] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:55:56.804133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec86e93-1ab8-4139-b04f-f86421e75a15 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:56.812577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:56.814158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:56.838751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:56.840315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:56.841275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:56.841275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:56.841275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:56.841275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:56.841275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 262/500] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:56.841275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:56.957653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec86e93-1ab8-4139-b04f-f86421e75a15 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:56.978465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5401-4af9-4f59-8d55-52c5faa0f1cd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.010691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.011952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.012409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.012897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.027001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:57.031992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d6499-a69f-4153-9485-25b7d8513857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.032865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6499-a69f-4153-9485-25b7d8513857 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.033146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6499-a69f-4153-9485-25b7d8513857 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.033418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6499-a69f-4153-9485-25b7d8513857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:57.035801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:57.037522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 239/501] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:55:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:57.039486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.049165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.053035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d6499-a69f-4153-9485-25b7d8513857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-173d6499-a69f-4153-9485-25b7d8513857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:55:57.060817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:57.067828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 263/502] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:55:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:57.069301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40012-7adc-476d-b550-d1890e156bed None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.070873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40012-7adc-476d-b550-d1890e156bed None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.070873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e40012-7adc-476d-b550-d1890e156bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.086271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-72e40012-7adc-476d-b550-d1890e156bed None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:55:57.087501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-72e40012-7adc-476d-b550-d1890e156bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:55:57.093384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.173010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 264/503] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:55:57.173982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40012-7adc-476d-b550-d1890e156bed None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.194602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafb1b-2863-4554-84bc-8fbb39403077 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.245038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.245731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.246013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.246292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.247062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:57.247376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.248857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.262854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 240/504] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:57.269116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.298646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e40012-7adc-476d-b550-d1890e156bed None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.331107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.336925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.337626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.337905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.338175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.338931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:57.339288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.340646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.354425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 265/505] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:57.355129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.381169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.387425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf126f-85f0-47ec-9daf-557bc3f91230 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.436253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.437746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.438201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.438362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.439056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:57.439360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.440843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.450822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 241/506] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:57.451709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.510267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b717a-7deb-4bfe-a37d-a87d278f5abc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.551585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.552267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.552548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.552848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.553636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:57.553942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.555388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.565329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 266/507] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:57.566184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.581620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35d2a-e20b-4fd4-aaf6-1697c2a8c0a7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.620498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.621590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.622043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.622491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.628538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.635571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.637166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:57.657971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:57.659204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:57.663990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:57.663990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:57.663990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:57.663990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:57.663990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 242/508] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:57.663990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.677667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.694350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edae8c-7643-4058-b52d-645fd522195c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.733260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.734212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.734519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.734928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.742473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.743919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:55:57.760030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:57.768819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 267/509] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:57.769942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.807799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f94986-1f6e-4129-939b-b13cfb288628 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.855858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.857090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.857521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.857944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.868265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.870042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:55:57.888605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:57.891680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 243/510] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:57.893708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:57.911710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4a5fe-b9b9-4767-a7a7-d3a667f9c5ea None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:57.928569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:57.962108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:57.963479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:57.963936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:57.964368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:57.982563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:57.984990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:57.999965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:58.014217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:58.016749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:58.018027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:58.018027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:58.018027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:58.018027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:58.018027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 268/511] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:58.018513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.047859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258c31f-fa19-4d5c-b738-276ec5abe9d4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.090859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.091820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.092284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.092954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.106596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.109129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:58.131120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:58.132901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:58.135223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:58.135223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:58.135223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:58.135223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:55:58.135223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 244/512] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:58.135223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.154212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09363697-8b70-4987-b874-a4cc93bccb89 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.211998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.213077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.213469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.213844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.215092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:58.215602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.219452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.246595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 269/513] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:58.246595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.281917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:58.312016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2504-0e1e-4b2f-851a-46ec4a89e6b6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.344866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:58.357961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.358998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.359242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.359570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.360292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:58.360597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.362089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.386918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 245/514] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:58.387737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec93fd-51bc-45ce-8f0a-15a3db7eb99f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.388723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.428692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.429387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.429663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.429932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.430768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:58.431070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.432508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.477592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 270/515] 10.222.0.71 () {56 vars in 1137 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:58.479347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.537011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dbf15-f7c7-42eb-80e0-4111c0860847 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.576693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:58.594878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.596008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.596500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.597027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.598358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:58.598557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dbef0-58a9-4efd-9147-0cd6b7575875 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.598993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.601589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.629767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 246/516] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:58.629767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.636235 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.637018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.637357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.637696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.638479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:58.638839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.642156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.657258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 271/517] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:58.658498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.680318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:58.745977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed740d-be29-4f85-8928-a6d2b0983052 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.792802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.793498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.793785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.794086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.794771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.796833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.825057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64091c-2f78-45e3-97e1-4600aded503e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:58.896179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:58.896960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:58.897353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:58.897717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:58.898721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=bd1a4928c641445e8b78a2836c680536) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:58.899196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:58.900947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:58.904562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 247/518] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:55:58 2022] POST /identity/v3/users => generated 247 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:55:58.906700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.919683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 272/519] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/role_assignments?user.id=bd1a4928c641445e8b78a2836c680536&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:58.919683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:58.945677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:59.114123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:59.119034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257895-6dbc-4941-a972-dad89078f706 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:59.155569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766122e5-9281-482b-9c7c-cfa1b5c5f313 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:59.191049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:59.193030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:59.194522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:59.194982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:59.220103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:59.221886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:59.222902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:59.223322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:59.244718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:59.244718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:55:59.262198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:59.264035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 273/520] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:59.266594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:59.357440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:59.361311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:59.396384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:59.463211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce1b83-2e8b-452f-a412-1e01585fdce1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:59.528982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:59.530400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:59.530831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:59.531219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:59.540666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:59.541633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:55:59.557761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:59.559588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 274/521] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:55:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:59.562128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:59.565064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:59.574791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 248/522] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:55:59.576860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:59.677922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ca1fa-e1d7-4e62-a57b-a3657fcbc809 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:59.706807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:55:59.718730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:59.718730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:59.718730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:59.718730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:59.719356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:59.719749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:59.724829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:59.745211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 275/523] 10.222.0.71 () {56 vars in 1139 bytes} [Wed May 18 13:55:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:59.746178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:59.778648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56a43a-2600-446d-93c3-0a2d12013fff None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:59.848404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:59.849799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:59.850253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:59.850723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:59.852393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:55:59.852969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:59.855989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:59.860129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953b3c5-a72a-4295-b487-0248b200ca8d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:55:59.900403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:55:59.901246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:55:59.901406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 249/524] 10.222.0.71 () {56 vars in 1137 bytes} [Wed May 18 13:55:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:55:59.901547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:55:59.901838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:55:59.903392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:59.915040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:55:59.916540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:55:59.937286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:55:59.939038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:55:59.942563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:55:59.942563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:55:59.942563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:55:59.942563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:55:59.942563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 276/525] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:55:59.942563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:55:59.982459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:00.021397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:00.070293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e21ab6-cc7d-4bd0-800c-2cb110303db2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:00.118906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048831d-82a5-4bd4-82a0-210c0eba40c5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:00.128061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:00.129128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:00.129620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:00.130098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:00.201222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:00.203683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:00.204640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:00.209348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:00.231275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:00.235204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:00.289486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:00.407139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 277/526] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:00.408339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:00.465579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:00.476837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:00.549328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c0b1-e78f-4c8e-9195-89e685937bb7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:00.585234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:00.643328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:00.644014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:00.644320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:00.644568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:00.645334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:00.645648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:00.647073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:00.652264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:00.682819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 278/527] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:00.684137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:00.736821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 250/528] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:00.736821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:00.897695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e534719-49af-4590-93ac-6186452ea459 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:00.959830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:00.961991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:00.962831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:00.969701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:00.971196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a63b46-3f8b-43fe-a246-779f710c6c7e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:00.991456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:00.994868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.015843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.016970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.017246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.017528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.025775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.027271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:01.034539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:01.036207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:01.037884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:01.037884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:01.037884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:01.037884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:01.041516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 279/529] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:01.043275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:01.043436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:01.044881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:01.047467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 251/530] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:01.057183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.081252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:01.152503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:01.179803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e30419-24e6-4a49-801c-eeb577b1faa6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.222820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.223535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.224032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.224196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.225086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:01.225404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.227097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.241709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 252/531] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:01.242616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.263604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ad812-0edf-4ea4-9c8c-8b51670e5399 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.332239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.334109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.334616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:01.335173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.335968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.357391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.361636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.364425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd084-7e78-41aa-b8ab-7f545dc07c23 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:01.398861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:01.400575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:01.403339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:01.403339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:01.403339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:01.403339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:01.407052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.407730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.408012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.408338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.409208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:01.409472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.410024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 280/532] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:01.411015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.412053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.432818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 253/533] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:01.432818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.558926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:01.564108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d59ae-1c9a-4394-81a4-03c3620c469c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.603795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.604454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.604731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.605038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.605860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=e898dd74aefe470ab60a8dc9a066f6f6) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:01.606168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.607737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.615227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 281/534] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/role_assignments?user.id=e898dd74aefe470ab60a8dc9a066f6f6&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:01.617795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.657595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826303cc-515f-46cb-818f-772c64d4126e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.728131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.729646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.730264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.730884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.733592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:01.733592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.736752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b2205-8dbe-476b-8bc4-0f7932ad00a5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.759893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 254/535] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:01.760224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:01.769325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb282dd-8187-454a-911d-417b4b01c5c9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.769700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb282dd-8187-454a-911d-417b4b01c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.769989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb282dd-8187-454a-911d-417b4b01c5c9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.771954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 255/536] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:01.772875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb282dd-8187-454a-911d-417b4b01c5c9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:01.800960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb1118-c008-481d-a00b-7896bd650e66 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.850556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:01.853203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.853983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.855330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.875186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:01.880038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3a2c633a-80ba-48aa-8ddf-0769dca97bd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:01.915052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:01.916862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:01.918684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:01.922737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 282/537] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:01.925227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:01.926634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:01.927277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:01.949858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb282dd-8187-454a-911d-417b4b01c5c9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:01.962300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:01.965370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:02.007954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:02.013354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.016494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.016494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.016887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.030557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:02.033631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:02.062997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:02.064663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:02.066336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:02.071394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 256/538] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:02.072860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:02.116393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 283/539] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:02.118321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:02.188874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:02.274477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a2e8f-868b-4bb4-9959-ac0c715d8531 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:02.308152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d0824-74d1-493a-be2b-9b828d51b87d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:02.340056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.341153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.341627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.342087 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.343927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:02.344459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:02.347251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:02.371881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 257/540] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:02.373516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:02.379097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.379795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.380112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.380472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.381334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:02.381652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:02.383126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:02.404517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 284/541] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:02.405355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:02.426643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:02.534407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdae1-e2ed-46a7-99ce-e661a0fb8332 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:02.577887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.578692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.578967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.579234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.580095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=fecaff6430634c0ba90cd9039c2a9775) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:02.580408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:02.582068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:02.594192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa068-3f4e-4dc0-ba0e-ddfacf25fcf4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:02.597226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 285/542] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:02 2022] GET /identity/v3/role_assignments?user.id=fecaff6430634c0ba90cd9039c2a9775&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:02.598284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:02.639229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:02.667386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.668943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.669510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.670162 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.705932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:02.734855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:02.738235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:02.743019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:02.744877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 258/543] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:02.754433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:02.812478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:02.872763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b126a-0c23-4e60-b3b7-130e8c33e454 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:02.934999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816e5e-0f69-488f-92fb-39ce680edb9a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:02.961006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.963087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.963736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.964363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.967257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=2673e2410816490896bc0c6835005e78) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:02.969263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:02.974417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90451dcc-fa87-4a65-a620-deae3a1ec6a3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:02.982853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:02.983777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.984249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.984538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.985396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:02.985715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:02.987128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:02.988970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 286/544] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:02 2022] GET /identity/v3/role_assignments?user.id=2673e2410816490896bc0c6835005e78&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:02.990494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc70a6-7815-45f6-9fb8-864cc0e857ee None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:02.990780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc70a6-7815-45f6-9fb8-864cc0e857ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:02.991119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc70a6-7815-45f6-9fb8-864cc0e857ee None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:02.992935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 287/545] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:03.005771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:03.009186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:03.009953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:03.019688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 259/546] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:03.025908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:03.048632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:03.051078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:03.173153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:03.220618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 288/547] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:03.266523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:03.383059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133ebd3-2d2a-443c-a550-7858f4145997 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:03.458741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:03.501618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:03.502868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:03.503378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:03.503843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:03.526038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:03.526936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27e8c5-df04-4975-8480-2a8ddc6b180b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:03.527537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:03.574084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:03.575519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:03.577568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:03.577568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:03.577568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:03.577568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:03.577568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 260/548] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 550 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:03.600702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:03.609141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:03.610339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:03.610833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:03.611326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:03.637086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:03.655421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:03.658065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:03.660071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 289/549] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:03.672428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:03.868681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:03.888539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7240c6-9174-4147-a087-cb528c158e56 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:03.975108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15286e-a7b6-46c7-85c3-1ec5673ee0ac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:03.980120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:03.980823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:03.981115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:03.981392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:03.982130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:03.982438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:03.984023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:04.015828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 261/550] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:04.022591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:04.049256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:04.055422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:04.062294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.062294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.062294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.062294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:04.062294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:04.062294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:04.085441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 290/551] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:04.095148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:04.225498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b51b40-9735-4692-9741-260468f8b48c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:04.250951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd478d-0194-4f5d-bc5d-e37eed8016eb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:04.272618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98c840-279c-4742-a003-68406df03330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:04.273886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98c840-279c-4742-a003-68406df03330 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.274389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98c840-279c-4742-a003-68406df03330 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.274870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98c840-279c-4742-a003-68406df03330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.287186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98c840-279c-4742-a003-68406df03330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:04.289066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98c840-279c-4742-a003-68406df03330 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bb98c840-279c-4742-a003-68406df03330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:04.309303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:04.310362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:04.311829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:04.311829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:04.311829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:04.311829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:04.314420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 291/552] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:04.322047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98c840-279c-4742-a003-68406df03330 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:04.346840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:04.348726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.349530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.350302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.376100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:04.379358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:04.421924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:04.429452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:04.430468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:04.431398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:04.432033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 262/553] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:04.443000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:04.486189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:04.569201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98c840-279c-4742-a003-68406df03330 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:04.682065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:04.683166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.683634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.684102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.685446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:04.685755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:04.688368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325616-f8ae-4d4f-a6cf-9c8265eef71e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:04.710557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509925ab-d296-451d-824b-5a81cff16474 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:04.712312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 292/554] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:04.714463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1fcba-3214-4782-bc8e-90f698d0b584 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.714907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1fcba-3214-4782-bc8e-90f698d0b584 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.715236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1fcba-3214-4782-bc8e-90f698d0b584 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.718124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 293/555] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:04.719503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1fcba-3214-4782-bc8e-90f698d0b584 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:04.765238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:04.765833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.766383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.766661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.767541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:04.767850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:04.769973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33277bd-a2df-4a28-b7c2-27068fb490b4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:04.795139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 263/556] 10.222.0.71 () {56 vars in 1135 bytes} [Wed May 18 13:56:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:04.799103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.799378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.799920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.826089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:04.828410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:04.919157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:04.924758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1fcba-3214-4782-bc8e-90f698d0b584 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:04.925865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 264/557] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:04.926862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:04.936410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:04.972387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:04.973248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:04.973533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:04.973811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:04.981922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:04.983794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:05.000725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:05.002256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:05.003237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:05.006814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 294/558] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:56:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:05.007791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.065047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1fc17-1139-48be-9c44-3fbb3f1ba5c3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:05.120365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:05.121944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.122454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.122949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.149643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3607d6-eaa8-4a2e-8145-ff5a1aee1dab None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:05.208570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:05.210528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.210838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.211330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.232673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:05.244543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:05.249292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:05.250640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:05.251482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:05.252818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:05.254560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:05.256968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 295/559] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:05.258048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.316496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:05.383186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 265/560] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:05.384364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.442579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf147-a8c1-49af-9ce4-5b8481c7b8c9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:05.492757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:05.493910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.494418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.494823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.495874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:05.496200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:05.499675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f78703-a092-4898-8b19-08755bf55415 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:05.512764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:05.519346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3de46-2ba9-47bc-858c-489a3975cc00 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:05.540557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 296/561] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:05.540557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6c38-a7a4-4562-89ad-0120acf95df9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.540557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6c38-a7a4-4562-89ad-0120acf95df9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.540557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6c38-a7a4-4562-89ad-0120acf95df9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.540557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 297/562] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:05.540557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6c38-a7a4-4562-89ad-0120acf95df9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.590775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:05.591757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.592135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.592687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.593661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:05.593965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:05.595432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:05.611170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 266/563] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:05.613111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.709615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:05.740238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6c38-a7a4-4562-89ad-0120acf95df9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:05.753600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4954685-9da3-4c2a-8126-61df81b1463e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:05.782824 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:05.783625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.783903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.784176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.795262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:05.797529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:05.803709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:05.805049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.805484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.805914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-76f75744-8b4c-4083-ad6f-545d1a193e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:05.816836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:05.817899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:05.818904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:05.818904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:05.818904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:05.818904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:05.818904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 298/564] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:05.822311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4ae2-849c-45b9-bafd-36e1751dc577 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.822781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4ae2-849c-45b9-bafd-36e1751dc577 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.822950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed4ae2-849c-45b9-bafd-36e1751dc577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.826106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:05.828676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:05.848815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f5ed4ae2-849c-45b9-bafd-36e1751dc577 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:05.850059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:05.851729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:05.853562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:05.853562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:05.853562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:05.853562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:05.853997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f5ed4ae2-849c-45b9-bafd-36e1751dc577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:05.854137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 267/565] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:05.854137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.876155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:05.968173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 299/566] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:05.969039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f62a3-a00e-4403-886c-a59740cb1193 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:05.969330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f62a3-a00e-4403-886c-a59740cb1193 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:05.969612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f62a3-a00e-4403-886c-a59740cb1193 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:05.971262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 300/567] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:05.972039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f62a3-a00e-4403-886c-a59740cb1193 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:05.998209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c17328-0be9-4591-8cfe-66b38d0feaca None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.059656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.060478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.060758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.061380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.072142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:06.076223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:06.080363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:06.110862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:06.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:06.114818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:06.114818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:06.114818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:06.114818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:06.114818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 268/568] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:06.114818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.129527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f62a3-a00e-4403-886c-a59740cb1193 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.189486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.190396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.190768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.191141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.192018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:06.192431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:06.194212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71f27-b8c2-40f1-b40b-ef95dfc7bb48 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:06.208703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 301/569] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:06.210204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.210522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.210775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.219769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:06.231271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:06.231523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:06.328725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f093c64-7c9e-4655-9dcf-e76f674583d6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.329906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 302/570] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:06.330973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.391710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.392543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.392983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.393337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.394175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:06.394541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:06.396242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:06.415565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 269/571] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:06.415565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.417961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:06.484903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949a2c6-2a20-456f-b756-022992255b97 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.540233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.541225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.541599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.541979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.555445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:06.561676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076677bb-8cfe-42eb-89a9-fce664a42de0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:06.565609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:06.567418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:06.569076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 303/572] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:06.572249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.599669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:06.612637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.613335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.615486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.615486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.615486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:06.615486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:06.616308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:06.631391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 270/573] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:06.632554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.718898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8d4d-f3e3-41d3-b7c0-6d11f39ba5f2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.743354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:06.760532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe12b-970b-4eb2-9abd-48f1d4effa5a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:06.774449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.775901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.776375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.777227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.786849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:06.788727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:06.806736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:06.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:06.810651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:06.811850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:06.811850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:06.811850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:06.811850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:06.812123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 304/574] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:06.812123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.835291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:06.850911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:06.852901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 271/575] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:06.854673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:06.922708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:06.958154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb2b8-ec63-4748-a544-18b94151ab28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.003235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f77bf-6d51-4ab5-ae4e-cd288d39bd4b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.004119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.005097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.005509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.005885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.014807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.016552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:07.032059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:07.033933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 305/576] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:07.036198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.050392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.051073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.051357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.051633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.052388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:07.052694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.054139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.063670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 272/577] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:07.064409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.092477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:07.198861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175868d-bc4c-4263-8e35-1d8b02d66625 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.204081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f9083-ee20-4d75-a1f4-8126a3ca3eeb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.207343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:07.242021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.242912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.243281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.243638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.244766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:07.245272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.247031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.256913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.257924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.258194 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.266660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.268129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.268277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 273/578] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:07.269794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:07.292061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:07.294075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:56:07.296728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:07.300211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 306/579] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:07.301294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.415068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be1cfb-004a-4970-be06-cb2f0ea5f00e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.419224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:07.428459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f232d-0d91-4d3b-b8d5-a2ebf210689e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.456742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.457450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.457742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.458016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.458771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:07.459086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.460466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.468849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.469649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.470037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.470473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.470657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 274/580] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:07.471445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.472083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:07.472622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.475351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.491284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 307/581] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:07.492504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.518012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:07.629569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38e70-7c01-4d30-af90-c5daab1d1807 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.643768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238359-3f13-479e-bc12-87624cad157b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.676287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.677669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.678097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.678542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.692034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.693121 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.693567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.694002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.695369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=98fdd10e85dd44e9a952b25557a8236f) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:07.695863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.697634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.698376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.700126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.709543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 308/582] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/role_assignments?user.id=98fdd10e85dd44e9a952b25557a8236f&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:07.710772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:07.731181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:07.733772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:07.745293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:07.745293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:07.745293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:07.745293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:07.745293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 275/583] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:07.745293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:07.758348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:07.872374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:07.898515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2837b-043e-43a8-95fa-794bb1ccef26 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.917667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403b061-77c7-49cc-87b1-e0b655f62b7d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:07.950003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.951331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.951831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.952286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.972874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.975719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:07.984996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:07.985842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:07.986242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:07.986638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:07.987641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:07.988091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:07.990219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:08.018884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:08.022131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:08.023839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:08.023839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:08.023839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:08.023839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:08.024255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 309/584] 10.222.0.71 () {56 vars in 1137 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:08.024255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.024501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 276/585] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:08.024501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.123209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:08.150309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e832-948d-4ebe-9c5b-ce54a9dd2d76 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:08.193933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:08.194937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:08.195206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:08.195477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/bd1a4928c641445e8b78a2836c680536/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:08.213640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=bd1a4928c641445e8b78a2836c680536, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:08.215168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:08.219841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e399f-2928-4be4-9aad-b48d2de2df47 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:08.263796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:08.270216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:08.271019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:08.271397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:08.271752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:08.272567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:08.273015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:08.274508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:08.288253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 277/586] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:08.289308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.303734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 310/587] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:08 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/bd1a4928c641445e8b78a2836c680536/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:08.305652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.511423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1eeb8-8ae4-4828-b3ca-276c872d2374 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:08.534912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3c757-31a0-4204-ae94-729d31178456 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:08.577969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:08.579030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:08.579502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:08.579965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:08.581340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:08.581849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:08.584384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:08.600346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:08.615915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 278/588] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:08.615915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.630065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:08.632522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:08.633251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:08.633857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:08.658981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:08.661565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:08.696700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:08.698461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:08.700291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:08.700291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:08.700291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:08.700291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:08.700727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 311/589] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:08.702217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.732272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:08.834212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84425a-b849-443d-b90e-067f2a1b9fc6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:08.901378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c150bdd-519d-479d-864f-71bac7c1c0a9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:08.912040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:08.913596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:08.914102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:08.914567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:08.932975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:08.937283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:08.966169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:08.974319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 13:56:08.976184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:08.978146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 279/590] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:08.979303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:08.990951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:08.992955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:08.993793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:08.994541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:09.014694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:09.018120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:09.053860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:09.055821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:09.057818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 312/591] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:09.060270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:09.144939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:09.204219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87552-1920-471f-8b13-f8a6f00b4fd3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:09.235685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:09.275431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8132fb-9ee3-43d5-bbda-b71a5876124f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:09.287054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:09.288112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:09.288591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:09.289099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:09.292479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:09.293117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:09.297077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:09.324550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 280/592] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:09.326334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:09.346986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:09.347758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:09.348224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:09.348693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:09.350337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:09.350901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:09.353719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:09.392540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 313/593] 10.222.0.71 () {56 vars in 1137 bytes} [Wed May 18 13:56:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:09.394200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:09.542953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2ba66-6ede-49af-8c01-ff9896f1e9ca None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:09.591776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:09.593615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:09.594137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:09.594631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:09.594931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:09.596404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:09.597002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:09.598677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:09.602594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff709c2-620e-4ef0-ab57-b55d837a19ef None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:09.620436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 281/594] 10.222.0.71 () {56 vars in 1139 bytes} [Wed May 18 13:56:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:09.621660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:09.657223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:09.681701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:09.683092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:09.683595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:09.684061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:09.696273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:09.698559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:09.724353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:09.725590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:09.726539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:09.733443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 314/595] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:09.735538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:09.749248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c250b3-c9b8-42cf-ab1f-32ee15e4b2f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:09.791128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:09.792284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:09.792773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:09.793483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:09.806776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:09.808574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:09.831766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:09.832744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:09.833684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:09.833684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:09.833684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:09.833684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:09.836834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 282/596] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:09.838107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:09.932779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08092d99-0338-4207-8b53-0737c2e608d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:09.941834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:09.963642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f69b7f-2ac0-44a4-a9d3-0e5582916cd2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:10.001893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.003288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.003820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.004270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.007816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.008874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.009447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.010004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.011029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:10.011566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.013274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.025931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.028211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 283/597] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:10.029319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:10.036756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:10.072767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:10.073821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:10.074761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:10.074761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:10.074761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:10.074761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:10.080985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 315/598] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:10.082586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:10.110306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:10.157964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcd61d-5486-4579-b513-74ecd5593318 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:10.199038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.200452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.205189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.206678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.208565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:10.209237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.210982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.229284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 284/599] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:10.230533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:10.238071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:10.294379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176ce5-6afd-4418-a402-20bb832cce82 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:10.368581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.370246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.371059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.371314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/e898dd74aefe470ab60a8dc9a066f6f6/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.374338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c7db-4dcc-4c5c-afaa-4d7ff0597577 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:10.401143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=e898dd74aefe470ab60a8dc9a066f6f6, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.404270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.420056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.421507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.425667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.425667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.425667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:10.425667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.425667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.438836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 285/600] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:10.439538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:10.523575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:10.528835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 316/601] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:10 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/e898dd74aefe470ab60a8dc9a066f6f6/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:10.531577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:10.615559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2939-3043-4b9d-9af5-c56d07ee566b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:10.671691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:10.739892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.741326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.741820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.742310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.768342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.771233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.811455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bea5-1e0d-493c-bc1f-f05edbc72fd0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:10.813030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:10.813936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:10.814858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:10.815841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 286/602] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:10.824026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:10.882280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:10.883039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:10.883311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:10.883587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:10.893928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:10.895410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:10.917612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:10.919329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:10.921584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 317/603] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:10.928026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:11.039470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c0498-f38f-4002-aa26-465eaa2931af None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:11.082322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:11.103440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:11.105479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.105479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.105885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.107309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:11.109030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:11.111862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014bcf2-9735-43d0-8446-b9f91229d017 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:11.136407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 287/604] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:11.143242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bd2cb-161a-4515-98e8-8dfe2436efa6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.143689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bd2cb-161a-4515-98e8-8dfe2436efa6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.144163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bd2cb-161a-4515-98e8-8dfe2436efa6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.151167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 288/605] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:11.152697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bd2cb-161a-4515-98e8-8dfe2436efa6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:11.178172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083fc36-ac34-40cd-b51b-4f9547c90ad6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:11.242216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:11.273486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:11.274497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.274966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.275471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.276922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:11.277428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:11.280171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053146-ca91-4a85-bad3-a2e692bcb376 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:11.302653 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 318/606] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:11.305016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.305483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.305941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.337260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:11.338643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:11.393561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bd2cb-161a-4515-98e8-8dfe2436efa6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:11.464088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:11.465219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 319/607] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:11.466313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.466640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:11.468497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.469288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/fecaff6430634c0ba90cd9039c2a9775/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.514463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=fecaff6430634c0ba90cd9039c2a9775, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:11.518718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:11.603902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 289/608] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:11 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/fecaff6430634c0ba90cd9039c2a9775/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:11.605778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:11.705938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e97f64-e30d-4880-ab84-a83e5328cefd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:11.713397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:11.748063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:11.823399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0107-a59b-4fa9-8c5c-ef153ffa3619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:11.824943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0107-a59b-4fa9-8c5c-ef153ffa3619 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.825415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0107-a59b-4fa9-8c5c-ef153ffa3619 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.825885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0107-a59b-4fa9-8c5c-ef153ffa3619 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/2673e2410816490896bc0c6835005e78/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.854240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e1fa2-a6f3-4d26-9c0b-fbbe9a3f571e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:11.881673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef0107-a59b-4fa9-8c5c-ef153ffa3619 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=2673e2410816490896bc0c6835005e78, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:11.884248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef0107-a59b-4fa9-8c5c-ef153ffa3619 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:11.922567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:11.924400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:11.925155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:11.926064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:11.947906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:11.963595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:11.965389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:11.967035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:11.971789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 290/609] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:11.983564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 320/610] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:11 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/2673e2410816490896bc0c6835005e78/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:11.984733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:12.082037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96bc10-8e53-4645-b9ec-1fd115fbf4d0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.082491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96bc10-8e53-4645-b9ec-1fd115fbf4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.082851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96bc10-8e53-4645-b9ec-1fd115fbf4d0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.093205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 321/611] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:12.099140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.099587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.100049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.130890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:12.133013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:12.190407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:12.208897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a6c60-a599-422b-ad82-f3a8c75d1047 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:12.297614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:12.298310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.298596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.298872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.299654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:12.299959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:12.301435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:12.311591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 291/612] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:12.319237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 322/613] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:56:12.321561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:12.395932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:12.478430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128700-9ed9-4416-9296-b67e515b9f25 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:12.532704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:12.533553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.533836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.534109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.546441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:12.547937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:12.567618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:12.569388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:12.571104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:12.571104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:12.571104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:12.571104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:12.571104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 292/614] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:12.581559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:12.597369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:12.659472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:12.698966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858be25-92b7-444c-9cd1-ef0351f3a9d9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:12.708405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7ad28-500c-4733-9937-647477c67f04 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:12.738225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:12.738905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.739189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.739468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.740204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:12.740509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:12.741954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:12.760819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 293/615] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:12.765006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:12.809397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:12.810208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.810494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.811297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.842724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:12.875971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:12.877788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:12.879509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 323/616] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:12.882544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:12.888037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:12.904366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244b7fd-44f0-4460-bbd3-bae1ec75bf55 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:12.959833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:12.960547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:12.961099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:12.961272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:12.970430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:12.971903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:12.988130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:12.990078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 294/617] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:12.996243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:13.157308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da424bb1-792e-499b-993e-02adbbf8bd64 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:13.188992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacc172-18f8-4bf1-ac0d-62c01f0c2222 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:13.212927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:13.221896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:13.222581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:13.222862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:13.223143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:13.224242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:13.224414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:13.226039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:13.250710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 295/618] 10.222.0.71 () {56 vars in 1135 bytes} [Wed May 18 13:56:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:13.254754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:13.324268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:13.325449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:13.325942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:13.327122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:13.329146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:13.329669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:13.332244 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:13.361372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 324/619] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:13.366122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:13.370305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e2ca3-7010-463a-84e5-8c05fd6b32e5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:13.395429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:13.412894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:13.414169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:13.414669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:13.415179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:13.427348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:13.429317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:13.454351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:13.455366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:13.456254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:13.456254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:13.456254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:13.456254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:13.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 296/620] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:13.465815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:13.529321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:13.580244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf32d-b32c-471d-b824-60be7922fbc1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:13.628217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72c1f-40e3-452c-b193-4917462fa19a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:13.698144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:13.699329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:13.699828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:13.700316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:13.701913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:13.702429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:13.705674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:13.707079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:13.707571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:13.708063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:13.710174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:13.734064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 297/621] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:13.734439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:13.737062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:13.740928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:13.772506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:13.773614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:13.774572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:13.774572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:13.774572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:13.774572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:13.776214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 325/622] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:13.784106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:13.934436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:13.934794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:13.954022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ca42f-4645-4f27-8a67-2bb1046c5c08 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:14.005230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b94fc2-f295-42c5-9bea-d1ca2b9e64a4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:14.076862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:14.078722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.079330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.079943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.081396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:14.082030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:14.084807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:14.113186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 326/623] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:14.116423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:14.124628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:14.125851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.126302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.126745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.157739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:14.160541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:14.202929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:14.203927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 298/624] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:14.214309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:14.377243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197df29-ccf2-4d51-9f43-89e6d7255aed None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:14.415344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf7867-bf94-427d-b906-2f6d8a87c19e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:14.435649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:14.460556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:14.462715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.463414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.464526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.485644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:14.488051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:14.488936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:14.489190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.489682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.490164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.491772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:14.492339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:14.495517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a967db-9066-42ad-b599-ca279474d382 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:14.522616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 299/625] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1e544a5c-0d09-43fd-af36-6d359676f7b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:14.524157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:14.526005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:14.527658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:14.528593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e9d5-4ee1-49cb-a751-051bfec34ab1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.528593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e9d5-4ee1-49cb-a751-051bfec34ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.528593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475e9d5-4ee1-49cb-a751-051bfec34ab1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.529134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 300/626] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:14.531200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475e9d5-4ee1-49cb-a751-051bfec34ab1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:14.533771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 327/627] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:56:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:14.536329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.537040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.537656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.576772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:14.579053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:14.579368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:14.734914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 328/628] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:14.737296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:14.774315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475e9d5-4ee1-49cb-a751-051bfec34ab1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:14.853951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:14.856359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.857560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.858275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/98fdd10e85dd44e9a952b25557a8236f/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.893954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=98fdd10e85dd44e9a952b25557a8236f, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:14.897887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:14.941100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc89a8-f3a6-4f75-9e01-59111a1bfe6a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:14.961088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:14.981089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 301/629] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:14 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/98fdd10e85dd44e9a952b25557a8236f/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:14.982776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:14.992980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:14.994094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:14.994578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:14.995063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:14.996130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:14.996648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:14.999139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:15.023621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 329/630] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:56:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:15.029358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:15.164069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:15.242754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51757313-1f32-4a6c-8917-f93148a301ae None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:15.321224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:15.322570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:15.323059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:15.323547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:15.328140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30aad-3fc5-45f9-bf3d-a1258431c310 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:15.345584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:15.361658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:15.362698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:15.363538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:15.364198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 302/631] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:15.372993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:15.377198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a92af-d088-48ce-8969-471607b268e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:15.378080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a92af-d088-48ce-8969-471607b268e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:15.379023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a92af-d088-48ce-8969-471607b268e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:15.379459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a92af-d088-48ce-8969-471607b268e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:15.440466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:15.562859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a92af-d088-48ce-8969-471607b268e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:15.565001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d909-e0cd-4dce-aa8c-89dca806d6d9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:15.565523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a92af-d088-48ce-8969-471607b268e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:15.617245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:15.629478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:15.630161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:15.630441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:15.630716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:15.631474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:15.631777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:15.633199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:15.662166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 303/632] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:15.672529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:15.793751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 330/633] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:15.796459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78a302-33b0-4cfc-aa1a-ba74067dc432 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:15.796765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78a302-33b0-4cfc-aa1a-ba74067dc432 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:15.797068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78a302-33b0-4cfc-aa1a-ba74067dc432 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:15.798518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 331/634] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:15.801839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78a302-33b0-4cfc-aa1a-ba74067dc432 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:15.875360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294673da-01f9-46ab-8668-21dadeec72b5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:15.923716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:15.925018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:15.925520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:15.926018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:15.937466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:15.939023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:15.940552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b1fb1490-bcf7-4434-960e-bb8d895ca3a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:15.959966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:15.961492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:15.962470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:15.962470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:15.962470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:15.962470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:15.962470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 304/635] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:15.965048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:15.965048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:15.965048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:15.993677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:15.994879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78a302-33b0-4cfc-aa1a-ba74067dc432 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:15.995045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:16.046688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:16.059536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.060354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.060688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.061019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.073732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:16.075201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-881e5d89-f8c1-45f9-bb7c-f03ec99a906d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:16.096435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:16.099391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:16.101207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:16.101207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:16.101207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:16.101207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:16.102455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 332/636] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:16.103875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a3ff-28c4-4905-aa20-57e24ff0dfa2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.104169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a3ff-28c4-4905-aa20-57e24ff0dfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.104602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a3ff-28c4-4905-aa20-57e24ff0dfa2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.106538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 333/637] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:16.106881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5a3ff-28c4-4905-aa20-57e24ff0dfa2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.124849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 305/638] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:16.124849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.275362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5a3ff-28c4-4905-aa20-57e24ff0dfa2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.280521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8136a2-1786-4c54-a45e-1afc4864c68b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.314585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:16.332433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.333586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.334095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.334552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.334813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.335498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.335770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.335892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:16.336020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.336369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:16.336737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:16.337070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:16.338530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3058ba-2209-4794-b445-81913a194869 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:16.338797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:16.360847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 306/639] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:16.360847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.360847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.360847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.361497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 334/640] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:16.362016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.383170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:16.385811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:16.426593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:16.484679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 307/641] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:16.486115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.507024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104fe49-e9da-4f82-86fe-63b22394ecdc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.554165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.555344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.555887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.556230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.569858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:16.577800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:16.579743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 335/642] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:16.581317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.634918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4817a-635c-4304-bc55-1a9ec4d5d410 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.636460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:16.698565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.699389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.699639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.699908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.707937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:16.709458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:16.710588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e66cf9-2acc-43be-b8d8-f02f26862b49 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:16.724876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:16.726000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:16.727048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 308/643] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:16.727578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.761804 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:16.769877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.771047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.771538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.772004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.781549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:16.783401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:16.799699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:16.800888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:56:16.802147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:16.805558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 336/644] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:16.806476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:16.887448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f0af-b69f-439b-8b1e-0acb3c30f577 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.935029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:16.937583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:16.938034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:16.938481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:16.940827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc801-1f5d-425e-9e71-f4580739c669 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:16.946184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:16.956108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:16.974622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:16.975656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 309/645] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:16.978047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.002699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.003383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.003888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.004065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.004856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:17.005167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.006728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.017202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 337/646] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:17.017807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.114864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:17.140463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ad5cf-e497-4075-819b-6ad571686244 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.159390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effe83c-d6df-417d-a293-264debcc4aa2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.204148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.204862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.206078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.206078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.206390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:17.206706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.208173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.208909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.209813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.210328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.210804 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.211810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:17.212414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.214341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.235491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 338/647] 10.222.0.71 () {56 vars in 1137 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:17.235491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.240477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 310/648] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:17.240477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.269719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:17.361603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691ae0-27cb-4618-9bfa-933b8db7fa3a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.403007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddf3ac-7bab-414d-86b8-7e3df9d92f3f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.406462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.408133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.408133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.408345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.409599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:17.410225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.412897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.432885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 339/649] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:17.432885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.452908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.453735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.454013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.454363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.465389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:17.468857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.470899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:17.497082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:17.498160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:17.499242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:17.499242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:17.499242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:17.499242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:17.508211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 311/650] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:17.509402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.590868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:17.613906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f6a20-53a9-4f6a-8049-8313d094638a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.634651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf221-2fc1-4171-ba1d-bcce87d3eb1a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.662407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97db300-19d4-48b7-9e7d-da389daff9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.663091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97db300-19d4-48b7-9e7d-da389daff9fa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.663502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97db300-19d4-48b7-9e7d-da389daff9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.663781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97db300-19d4-48b7-9e7d-da389daff9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.696216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.697036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.697205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.697462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.698302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=bd1a4928c641445e8b78a2836c680536) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:17.698616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.700086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.712829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 312/651] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/role_assignments?user.id=bd1a4928c641445e8b78a2836c680536&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:17.712829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.787915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97db300-19d4-48b7-9e7d-da389daff9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.790945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97db300-19d4-48b7-9e7d-da389daff9fa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.803266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:17.868253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e97312-3038-4e8a-81ff-e1edfb53501c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:17.918118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:17.923770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.923770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.923770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.933688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:17.934830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:17.942978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:17.956151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:17.975948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:17.977692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:17.977692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:17.977692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:17.977692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:17.977692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 313/652] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:17.977692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:17.978153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 340/653] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:17.978153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b55c-883b-4c78-9ff9-c0344d10a74b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:17.978153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b55c-883b-4c78-9ff9-c0344d10a74b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:17.978153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b55c-883b-4c78-9ff9-c0344d10a74b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:17.978153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 341/654] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:17.978153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b55c-883b-4c78-9ff9-c0344d10a74b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.088306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b55c-883b-4c78-9ff9-c0344d10a74b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.104009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfc182-06bc-484a-b780-5022ba580f95 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.117441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:18.130528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.130528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.130528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.130528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.131147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:18.131147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.131147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.143602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 342/655] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:18.144458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.148844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.150545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.150887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.151135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.151871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:18.152182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.153604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1aca-379c-416b-aa79-036ffcbdd74d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.171073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 314/656] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:18.171073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.171073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.171073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.186687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:18.187908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:18.204409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:18.276572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425eee3c-67d1-441e-88f8-c40d8a60a3a1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.288992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 315/657] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:18.288992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.330427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.331353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.331808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.332268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.344279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.345781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:18.364344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:18.365442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:18.367130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:18.367130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:18.367130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:18.367130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:18.367130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 343/658] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:18.367130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.396930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:18.401166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c4e21-6a33-41ff-b68d-b3c445657de8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.456542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.457921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.458491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.458925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.473347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.475918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.478791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:18.483718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4851-c0dd-4a21-bbc9-b3627930cec2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:18.494628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:18.496425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 13:56:18.497450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:18.501166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 316/659] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:18.502916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.527411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.528572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.528572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.528857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.538863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.541261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:18.560754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:18.561851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 344/660] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:18.567839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.634393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935f3ca-b5c0-4041-bb46-5b41ae9a6f31 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.680412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.681312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.681589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.681860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.694938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:18.703425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:18.706154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:18.707199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:18.709612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 317/661] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:18.710380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.736049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:18.814487 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3432fa8-5f70-4957-bdec-83912ce76f1f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.840174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01e39-dde6-4f03-a708-990ab9ecf159 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:18.855013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.855788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.856138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.856473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.857299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:18.857606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.859193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.878113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 345/662] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:18.878113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:18.890281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:18.890281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:18.890281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:18.890281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:18.893463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:18.893463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:18.893463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:18.909855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:18.918168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 318/663] 10.222.0.71 () {56 vars in 1137 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:18.918168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.024353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:19.033979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffcd8e-d821-44c1-826b-020e5c9afbb9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:19.054169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f612bc-0bb4-44de-a6b6-7521e79dba10 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:19.081483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:19.082677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:19.083200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:19.083655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:19.084673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:19.085165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:19.086769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:19.105220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:19.107141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:19.107490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:19.108235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:19.109103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:19.111828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:19.113505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:19.119424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 346/664] 10.222.0.71 () {56 vars in 1139 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:19.120196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.135550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 319/665] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:19.135550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.246963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:19.274628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7e52-ba33-4f89-a866-21e44db5ab3f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:19.319963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c26dbe-effd-4883-88ce-ae256fb479e1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:19.326703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:19.327844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:19.328347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:19.328717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:19.337958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:19.339432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:19.355000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:19.364966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 347/666] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:19.366985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.389876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:19.390591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:19.391238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:19.391757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:19.406040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:19.516697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:19.518242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:19.538279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1f74-7a72-4b4c-8def-b58a6120b72d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:19.594297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:19.595817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:19.596557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:19.597307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:19.604203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:19.681617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 320/667] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:19.683387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.730551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:19.734199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:19.750561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:19.860040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192b367-42ea-4aa7-866d-a6422f853753 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:19.919386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:19.921748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:19.922236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:19.922754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:19.928979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 348/668] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:19.928979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.944056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:19.946506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:19.979993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:19.981009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:19.981925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:19.981925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:19.981925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:19.981925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:19.981925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 321/669] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:19.983535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:19.989619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:20.129882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5771-cd9f-4d36-8374-ea09476ced4b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.203106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:20.204267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.204776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.205317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.206826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:20.207363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:20.210341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:20.232741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 349/670] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:20.232741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:20.297269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:20.315457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781b481-c88b-4fc9-baf7-8ca54d2387aa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.377626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:20.378931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.379407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.379957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.394421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:20.398848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:20.401597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:20.406634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420780d-e60c-4c56-92fc-0fb70e202267 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:20.438134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:20.439844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:20.442203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:20.442203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:20.442203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:20.442203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:20.447680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 322/671] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:20.449110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:20.466268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:20.468251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.468533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.468828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.479847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:20.481321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:20.505892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:20.507651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:20.510208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:20.510208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:20.510208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:20.510208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:20.510208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 350/672] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:20.510208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:20.591380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716d8ed-64d9-4433-9f7d-4c806d7e0310 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.639043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:20.639784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.640163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.642657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.643805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:20.644193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:20.645852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:20.661238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 323/673] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:20.662462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:20.666443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:20.676706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c977-1bbe-4ff1-8c88-d97879535d69 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.728037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:20.728696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.729066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.729344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.730201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=e898dd74aefe470ab60a8dc9a066f6f6) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:20.730509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:20.731940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233a6ae-fb00-4779-bed5-f4f3744ef45a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:20.739345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 351/674] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:20 2022] GET /identity/v3/role_assignments?user.id=e898dd74aefe470ab60a8dc9a066f6f6&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:20.740653 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab2a7-4b27-4007-bd8e-f883c42056a8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.741089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab2a7-4b27-4007-bd8e-f883c42056a8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.741239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab2a7-4b27-4007-bd8e-f883c42056a8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.744175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 352/675] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:20.744175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fab2a7-4b27-4007-bd8e-f883c42056a8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:20.771577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:20.823564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204a69-9e00-434a-b4a8-35722bc1feba None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.867713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:20.868398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:20.868676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:20.869039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:20.869710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:20.870013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:20.871416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:20.895559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 324/676] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:20.895559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:20.936809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fab2a7-4b27-4007-bd8e-f883c42056a8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:20.998943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:21.006739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.008302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.010259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.010259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.010847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:21.011358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:21.014456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587a849-0676-42e4-8c09-ab4f02ba8f44 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:21.041618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 353/677] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:21.041618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.041618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.041618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.064062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:21.065498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:21.083722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d89a4-1277-4ce4-bc50-c4143823a53b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.143428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a847c-447a-405b-a595-29a461901644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.144555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a847c-447a-405b-a595-29a461901644 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.145000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a847c-447a-405b-a595-29a461901644 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.145417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a847c-447a-405b-a595-29a461901644 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.156739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a847c-447a-405b-a595-29a461901644 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:21.158445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a847c-447a-405b-a595-29a461901644 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:21.176298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 354/678] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e46a847c-447a-405b-a595-29a461901644 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:21.176557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:21.178439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:21.180398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:21.183116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.185296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 325/679] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:21.187698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a847c-447a-405b-a595-29a461901644 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.188470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:21.338063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a847c-447a-405b-a595-29a461901644 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.370420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8147e-e466-4c60-a821-5f29a970e7ab None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.379572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:21.401842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.403208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.403692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.404199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.413803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.414857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.415130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.415411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.417002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:21.419652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:21.424465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:21.425945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:21.441698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:21.443468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 355/680] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:21.445313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:21.453048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:21.454781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:21.457070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:21.458958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 326/681] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:21.459862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.555378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:21.606213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5ab24-8157-4463-9529-64cbb134a9fa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.641814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78cd25-a86a-48b4-93f5-cfa0675c72a0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.658139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.659151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.659584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.659982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.675483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:21.684401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:21.687702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 327/682] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:21.690895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.719791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.721021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.721549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.722077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.723134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:21.723499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:21.726131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:21.759508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:21.771777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 356/683] 10.222.0.71 () {56 vars in 1135 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:21.771777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.866330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefa5e5-070e-4740-88c6-b6efd2006468 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.918748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:21.920081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:21.920473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:21.920946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:21.921784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:21.922127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:21.923923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:21.933409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1b9b8-057c-471f-ba7a-c5d544b03f62 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:21.956701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 328/684] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:21.956701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:21.979372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:22.006325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.007157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.007603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.008044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.009346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:22.009850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.012048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.040153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 357/685] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:22.040153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:22.113455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4001d7-64cd-49d4-8032-12c14e6a43c5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:22.115720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:22.158027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.158705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.158983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.159261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.160023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:22.160317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.161790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.171427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 329/686] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:22.172296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:22.189741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f9af-6bdb-4f2c-9b38-6552c6e4636e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:22.262621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.264486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.265571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.265771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.353613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b7a0f-ced4-4d47-9ae6-cf3e4d26339f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:22.363994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:22.396989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.397650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.398472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.398769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.399607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=fecaff6430634c0ba90cd9039c2a9775) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:22.399912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.401375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.403399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.406565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.417199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 330/687] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/role_assignments?user.id=fecaff6430634c0ba90cd9039c2a9775&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:22.417199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:22.471779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:22.618317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 358/688] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:22.620051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:22.642790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9601-0c09-4206-a094-07b052553874 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:22.700038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.701399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.701930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.702680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.703446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=2673e2410816490896bc0c6835005e78) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:22.703821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.705543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.712747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 331/689] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/role_assignments?user.id=2673e2410816490896bc0c6835005e78&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:22.713856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:22.751827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:22.778791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93b9f-23d5-4f06-b071-142445153fa8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:22.832481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.833454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.833806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.834148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.849080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.850741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.851642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:22.865488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c28b17-9b75-443f-89ca-63494297b253 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:22.875085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:22.876086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:22.877032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:22.877032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:22.877032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:22.877032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:22.877032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 359/690] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:22.886018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:22.913299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:22.914124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:22.914404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:22.914677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:22.928252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:22.929825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:22.950517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:22.951533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:22.952530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:22.952530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:22.952530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:22.952530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:22.952754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 332/691] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:22.961607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:23.062357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204a232-e494-4c51-8269-1a0d105a1561 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:23.110974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:23.118038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:23.123940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.123940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.123940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.123940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:23.123940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:23.123940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:23.139348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 360/692] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:23.148115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:23.184481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab013488-c5fd-4e7e-aa97-a14e7937d639 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:23.270418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:23.272017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.272859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.273623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.275281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:23.276128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:23.279343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:23.280690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d40558-004d-4eeb-8287-eeb255dd39cc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:23.302741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 333/693] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:23.311898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:23.318824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:23.335128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:23.337026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.342627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.343716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.372048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:23.376765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:23.412366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:23.414308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:23.416129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 361/694] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:56:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:23.421202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:23.490000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:23.597229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c00391-b931-44f9-98b4-2a5fb09a6fbb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:23.639984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77468ba-7264-4a69-8d15-77a66c2a9df2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:23.645160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:23.645953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.646340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.646716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.647707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:23.648124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:23.649755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9eafd-5128-4d40-b44e-3533e26dac48 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:23.673289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 362/695] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:56:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:23.674901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdeed6-0d25-4400-82fb-9274f5db24c2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.675293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdeed6-0d25-4400-82fb-9274f5db24c2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.675670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdeed6-0d25-4400-82fb-9274f5db24c2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.681710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 363/696] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:23.682851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdeed6-0d25-4400-82fb-9274f5db24c2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:23.709593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:23.710586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.710976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.711351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.720946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:23.722601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3eb964d0-0f5f-4a09-8ec0-9c6d57d8ecbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:23.739701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:23.741540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:23.743628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 334/697] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:23.744772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.744772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.744772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:23.786621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:23.787848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:23.867506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:23.890344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 335/698] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:23.892627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:23.897640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdeed6-0d25-4400-82fb-9274f5db24c2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:23.927064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:23.975830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:23.976496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:23.976777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:23.977110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:24.065263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53740-9dbb-417e-9893-418318f8cd2a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:24.110909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:24.113439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:24.126349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:24.127969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:24.129834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:24.130797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:24.132766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:24.134688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:24.140202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:24.174279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 336/699] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:24.176197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:24.330957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:24.353139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 364/700] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 13:56:24.354842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:24.380652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:24.434300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb942f-7c46-4252-af1a-2ccdcbd0a923 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:24.489377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27817785-6bcb-4f9d-84b4-616b24e12f20 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:24.501016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:24.502001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:24.502383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:24.502755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:24.503516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:24.505893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:24.524734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:24.526955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:24.529347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 337/701] 10.222.0.71 () {56 vars in 1129 bytes} [Wed May 18 13:56:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:24.532217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:24.560761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:24.561849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:24.562193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:24.562530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:24.563443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=98fdd10e85dd44e9a952b25557a8236f) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:24.563815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:24.565719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:24.572560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 365/702] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:24 2022] GET /identity/v3/role_assignments?user.id=98fdd10e85dd44e9a952b25557a8236f&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:24.573564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:24.665090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:24.698737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2f75-a504-4b88-ac2b-e17e05c88aac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:24.716447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd601-bf47-444a-acf1-a67043a7e262 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:24.749267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:24.749996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:24.750277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:24.750549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:24.751296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:24.751821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:24.753146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:24.757475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:24.770673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 366/703] 10.222.0.71 () {56 vars in 1124 bytes} [Wed May 18 13:56:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:24.780160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:24.793016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:24.795904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:24.796945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:24.797675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:24.821082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:24.824413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:24.868801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:24.870435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:24.872104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:24.872104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:24.872104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:24.872104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:24.872104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 338/704] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:24.880534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:25.100698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222fc80-0088-477f-8643-aef03ce180ee None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:25.171406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:25.172488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.172949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.173439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.174754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:25.175316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:25.177808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243115-6f57-4d53-9b2a-f7eb72d0044d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:25.179506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:25.200979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 367/705] 10.222.0.71 () {56 vars in 1124 bytes} [Wed May 18 13:56:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:25.277245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:25.279474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.280260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.281253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.283016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:25.283941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:25.287007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481bf71-e5bd-4a8e-8788-c6f128ad12a1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:25.315415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 339/706] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:25.324479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:25.337279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:25.422979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132aaca-dcd3-42c9-b204-ce179b758358 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.423847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132aaca-dcd3-42c9-b204-ce179b758358 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.424564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132aaca-dcd3-42c9-b204-ce179b758358 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.431876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 340/707] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:25.437843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.438245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.438424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.464964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:25.467111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:25.517211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:25.551087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c0018-164e-4daf-967f-b956d675d87e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:25.622688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:25.622960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.623414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.623924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.625719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 341/708] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:56:25.640615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:25.643513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:25.651075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:25.673262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:25.674204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:25.675088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:25.678816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 368/709] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:25.685421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:25.825277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:25.851146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77766adf-fa7c-4a92-a7a8-f8a1f00dbe7a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:25.882385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139135-2afd-4d46-a267-08998af13b7a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:25.889929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:25.890836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.891375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.891649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.892307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:25.893720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f4eced7f-f67d-4840-ba48-5307a12d36e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:25.906598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:25.907662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:25.908504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 342/710] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:25 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:25.909678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfa599-110e-41bc-9b06-b64760575eb8 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.909787 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfa599-110e-41bc-9b06-b64760575eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.912328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfa599-110e-41bc-9b06-b64760575eb8 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.915566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 343/711] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:25.916537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfa599-110e-41bc-9b06-b64760575eb8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:25.955343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:25.956522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.956988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:25.957254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.957817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:25.960836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:25.961525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:25.964331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f00aa-8f8b-429d-81b4-5e31f0b5191e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:25.988990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 369/712] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:25.990636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:25.991189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:25.991570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:26.012300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:26.014028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:26.056671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfa599-110e-41bc-9b06-b64760575eb8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:26.101917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 370/713] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:26.103201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:26.103879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:26.104163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:26.104439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:26.105201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] RBAC: Adding query filter params (name=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:26.105514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:26.105812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:26.107442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:26.119703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 344/714] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:56:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:26.122526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:26.207940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:26.278287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:26.284607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886c23-ae86-463b-afc1-d6697c651844 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:26.293738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64af57-ca48-4088-927b-87c47351f6ee None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:26.342032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:26.343215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:26.343511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:26.343880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:26.344159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:26.344438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:26.344665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:26.345182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:26.345286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] RBAC: Adding query filter params (type=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:26.345536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:26.346548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=bd1a4928c641445e8b78a2836c680536) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:26.346912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:26.347339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:26.349359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:26.357398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 371/716] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:26 2022] GET /identity/v3/role_assignments?user.id=bd1a4928c641445e8b78a2836c680536&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:26.358631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:26.361164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 345/716] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:56:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:26.493527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c218eab-5425-447e-86a3-1c4e90a2589a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:26.518619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:26.542110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:26.543353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:26.543876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:26.544964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:26.559208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:26.561155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:26.581776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:26.582776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:26.583693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:26.583693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:26.583693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:26.583693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:26.586145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 372/717] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:26.592821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:26.721027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59c92c-86b9-409c-a103-9d76e4b8da21 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:26.759722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:26.760749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:26.761261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:26.761752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:26.762683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:26.763457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:26.765349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd73c19-01b1-4a42-84ed-7a9a89881f4f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:26.783863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 346/718] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:26.790280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:27.049012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60a24-904e-403d-b973-8e1e3ff7a41f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:27.102752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606154e-417d-4204-934d-a5228814e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:27.103451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606154e-417d-4204-934d-a5228814e4d9 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:27.103738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606154e-417d-4204-934d-a5228814e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:27.104015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606154e-417d-4204-934d-a5228814e4d9 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:27.104734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606154e-417d-4204-934d-a5228814e4d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:27.106207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606154e-417d-4204-934d-a5228814e4d9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:27.189772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 373/719] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:56:26 2022] POST /identity/v3/users => generated 254 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:56:28.592762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537dd98-8453-430a-b78c-43fa9f7a3576 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:28.593817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537dd98-8453-430a-b78c-43fa9f7a3576 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:28.594334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537dd98-8453-430a-b78c-43fa9f7a3576 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:28.596336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 347/720] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:28.602766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:28.603744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:28.604444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:28.629082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:28.630752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:28.660755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:28.714827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc7454-5768-4d21-a3ba-79577557278e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:28.715189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc7454-5768-4d21-a3ba-79577557278e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:28.715381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc7454-5768-4d21-a3ba-79577557278e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:28.717240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 348/721] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:28.724213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:28.724542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:28.724778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:28.746654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 374/722] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:56:28.746870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:28.752348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:28.757263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:28.782862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:28.866270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 349/723] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:56:28.927125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:28.968154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feae44f-407b-4976-8b07-1a2414802439 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:29.052717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0526d-3aa7-41b6-908a-4ac32317061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:29.053420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0526d-3aa7-41b6-908a-4ac32317061e None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.053698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0526d-3aa7-41b6-908a-4ac32317061e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.053968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0526d-3aa7-41b6-908a-4ac32317061e None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.054707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0526d-3aa7-41b6-908a-4ac32317061e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:29.056090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0526d-3aa7-41b6-908a-4ac32317061e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:29.128825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a62cb-4f4d-4488-8afe-28140384ae0d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:29.162327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 375/724] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:56:28 2022] POST /identity/v3/services => generated 251 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:29.171849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f482b8-0151-441b-a647-a922e64fabab None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.172306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f482b8-0151-441b-a647-a922e64fabab None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.172810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f482b8-0151-441b-a647-a922e64fabab None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.175567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 376/725] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:29.182827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144794c5-c00d-4c0d-a9ea-f97aba3d6c42 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.183159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144794c5-c00d-4c0d-a9ea-f97aba3d6c42 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.183474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144794c5-c00d-4c0d-a9ea-f97aba3d6c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.239920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:29.249916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.250230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.250473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.252659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-144794c5-c00d-4c0d-a9ea-f97aba3d6c42 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:29.254058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-144794c5-c00d-4c0d-a9ea-f97aba3d6c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:29.274501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:29.281544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:29.283693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:29.298305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:29.299353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:29.300229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 350/726] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:29.303857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:29.360226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 377/727] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 13:56:29.362217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0833f-8885-4e86-a376-42f0899d5e1f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.362789 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0833f-8885-4e86-a376-42f0899d5e1f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.363271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0833f-8885-4e86-a376-42f0899d5e1f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.365267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 378/728] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:29.375096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.375096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.375096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.402962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:29.406338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:29.501896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 379/729] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 13:56:29.502783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:29.503420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1435ce-a48a-4806-9fb7-4aba436156fd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:29.571552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:29.572255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.572553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.573113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.574062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:29.574484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:29.576390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:29.587613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 351/730] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:29.590582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:29.613934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:29.660294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd526d-5791-40c0-a92a-8a0c2f6b7e67 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:29.661637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:29.699613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:29.701662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.702142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.702569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.707726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb817ac-9b50-4046-bba7-f986fe6b5a6f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:29.715313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:29.723993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:29.725266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:29.726370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:29.728733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 380/731] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:29.729904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:29.745040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:29.745846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.746154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.746408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.747142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:29.749420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:29.837252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 352/732] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:56:29 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:29.838899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:29.879720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab843436-b627-4044-8a14-1ac2918304df None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:29.938512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:29.965860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:29.967458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:29.968964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:29.973589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:29.998469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.001466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:30.044734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:30.046319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:30.047622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:30.047622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:30.047622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:30.047622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:30.047622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 381/733] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:30.052154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.066087 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38cff-7c4c-4411-b70a-84a8e3795983 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.091679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:30.112466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.113434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.113865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.114313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.115322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:30.115780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.117357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.131525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 353/734] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:30.137376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.197534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19005431-5da1-4524-904f-9d3b2805c39c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.237480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.238172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.238777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.238777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.239490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:30.239738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.241177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.256268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 382/735] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:30.262576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170aeec8-0534-4755-9eca-b6c0192239fc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.263342 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.304545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.305731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.306161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.306604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.319163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.320941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.326997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:30.344175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:30.345387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:30.346457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:30.346457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:30.346457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:30.346457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:30.348416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 354/736] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:30.354193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.393285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30dc46-8d73-4ac0-a32e-51e590a40909 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.396495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:30.430191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.430995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.431281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.431559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.440199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.441716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:30.458525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:30.459702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:30.461195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 383/737] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:30.465564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.486069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caead56e-035a-4fac-bef6-ff317683ff8b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.556381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.557374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.557801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.558218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.559117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:30.559570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.561721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.584819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a86ff1-c8bb-4a3d-af21-4f5b4113fecc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.588872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 355/738] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:30.593172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:30.594864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.630580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.631264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.631549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.631827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.632744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:30.633081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.634530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.674040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 384/739] 10.222.0.71 () {56 vars in 1135 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:30.679636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.805614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:30.808838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccbb1-4efe-4957-abd4-2cc02d8aeda5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.816235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dbd47-d46b-4cbe-a21b-4cb24cff823d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:30.854867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c6580-48c2-42a7-a258-59970d547640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.855532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c6580-48c2-42a7-a258-59970d547640 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.855814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c6580-48c2-42a7-a258-59970d547640 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.856087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c6580-48c2-42a7-a258-59970d547640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.864235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:30.865745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.866640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.867464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.881002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.882907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:30.890809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f3b9b0f8-8548-46dc-a96e-3091ad531364 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:30.903157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:30.906381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:30.907344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:30.909736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 356/740] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:30.911819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee86c-8f86-47fe-91f3-930d23c784a9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:30.912344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee86c-8f86-47fe-91f3-930d23c784a9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:30.912855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee86c-8f86-47fe-91f3-930d23c784a9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:30.915459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 357/741] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:30.916536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee86c-8f86-47fe-91f3-930d23c784a9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:30.961374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c6580-48c2-42a7-a258-59970d547640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:30.962845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c6580-48c2-42a7-a258-59970d547640 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:31.111593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 385/742] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 13:56:31.112991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44559906-1ad8-4058-a281-e82671e44abd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.113279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44559906-1ad8-4058-a281-e82671e44abd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.113618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44559906-1ad8-4058-a281-e82671e44abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.121567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee86c-8f86-47fe-91f3-930d23c784a9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.131845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-44559906-1ad8-4058-a281-e82671e44abd None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:31.133112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-44559906-1ad8-4058-a281-e82671e44abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:31.173052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:31.174179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.174782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.175524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.176890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:31.177623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:31.179419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:31.200135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:31.206452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 358/743] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:56:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:31.207765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.221027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 386/744] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:31.222440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44559906-1ad8-4058-a281-e82671e44abd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.238303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:31.360884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fbe333-8379-4f4f-ab52-116a095ceb5f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.396107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44559906-1ad8-4058-a281-e82671e44abd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.408138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:31.409099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.409289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.409540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.423052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:31.424522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:31.449778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:31.452150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:31.453706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:31.453706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:31.453706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:31.453706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:31.456935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 359/745] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:31.457934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.459636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:31.461752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.462526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.463016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.484229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:31.486293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:31.523356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:31.524357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:31.525284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:31.525284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:31.525284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:31.525284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:31.532511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 387/746] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:31.534573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.537843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:31.586959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301ac2a-df2d-48e6-9cc8-f799762f9630 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.628872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:31.651173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:31.652660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.653286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.654497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.675652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:31.689934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:31.691715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 360/747] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:31.702527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.744217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2437f-1e6a-4429-9c3a-2cc8114aa78b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.791418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:31.792828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.793298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.793760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.795297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:31.795802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:31.798015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:31.813454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 388/748] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:31.814684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.879540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdec154-5f65-4fa3-8211-a8d113a62ada None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.912557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:31.928541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:31.930076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:31.930076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:31.930258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:31.931217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:31.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:31.933861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:31.950464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 361/749] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:31.951624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:31.955527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1a71-fc26-4cc4-bdc5-10f893b5d696 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:31.958706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:31.999809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.000988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.001495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.001981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.003441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:32.004005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.006460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c07df-798c-4b73-97cd-e62cabe22c6f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.025000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 389/750] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:32.028172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88396a-883e-4bae-826b-3d62efe0c2ea None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.029589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88396a-883e-4bae-826b-3d62efe0c2ea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.029872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88396a-883e-4bae-826b-3d62efe0c2ea None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.031300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 390/751] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:32.032062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88396a-883e-4bae-826b-3d62efe0c2ea None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.079408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc9da-0e6d-4e1d-a973-5954fc852059 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.120494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.121385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.121699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.121980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.130965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.132439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:32.149275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:32.157906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 362/752] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:32.159723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.215218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:32.228861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88396a-883e-4bae-826b-3d62efe0c2ea None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.280411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.281823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.282392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.282921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.294206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.295676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.311447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068d5a1-6f99-4dd7-b4d7-15def0404d23 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e04f6fe7-c5b9-4a9d-a5cb-ff5a7793e016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:32.313903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:32.315520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 391/753] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.318063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.320690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.336017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:32.337273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:32.365667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:32.379994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.380950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.381619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.381905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.395789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.397338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:32.426140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:32.427907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:32.429738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:32.429738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:32.429738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:32.429738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:32.429738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 363/754] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:32.429738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.453103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 392/755] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:32.453103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.577839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:32.578102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c36f-44e6-4414-8412-8788c809ec3b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.586054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb75fc-e930-401d-8020-34d627f26990 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.626786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.627570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.627860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.628140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.629009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:32.629412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.630830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.635411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.636862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.637337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.637978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.639626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:32.640288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.643122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.654681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 364/756] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:32.654681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.671183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 393/757] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:32.676101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.702077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:32.811202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7631b-99c8-4603-9b69-c6e3c6fc3160 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.836768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820273-4812-4e80-92b5-d058b4a5aaf1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:32.862713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.863479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.863827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.864180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.864963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:32.865271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.866672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.880824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 365/758] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:32.882874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.885912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:32.887954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:32.888728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:32.889096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:32.889863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:32.891551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:32.901881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:32.906808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:32.908779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:32.910521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 394/759] 10.222.0.71 () {56 vars in 1129 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:32.912057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:32.995008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:33.009209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548f930-e6c9-4eaf-b617-9eab5366a06d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.019006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb642e3-1e6e-4ab7-bb0e-082679e8f12d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.047200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.048239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.048239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.048769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.049230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=98fdd10e85dd44e9a952b25557a8236f) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:33.049806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:33.050961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca0dbb-75c2-4633-b4c2-4dc706fe893a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:33.057202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 366/760] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:32 2022] GET /identity/v3/role_assignments?user.id=98fdd10e85dd44e9a952b25557a8236f&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:33.058632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847357e-9696-488d-940f-f89cf5248dc2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.059013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847357e-9696-488d-940f-f89cf5248dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.059386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847357e-9696-488d-940f-f89cf5248dc2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.064935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 367/761] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:33.064935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847357e-9696-488d-940f-f89cf5248dc2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:33.067548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.069167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.069669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.070158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/bd1a4928c641445e8b78a2836c680536/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.073692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=bd1a4928c641445e8b78a2836c680536, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:33.076718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:33.151897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 395/762] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:32 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/bd1a4928c641445e8b78a2836c680536/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:33.153433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:33.218701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:33.246798 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847357e-9696-488d-940f-f89cf5248dc2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.296210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.296918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.297203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.297666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.307779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:33.309475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b5017c0f-65b6-43df-a119-e36047fff055 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:33.329126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:33.330270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:33.331358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:33.335374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 368/763] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:56:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:33.337041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.337329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.337610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.358707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:33.359874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:33.384063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da1c15-bb23-4c3c-a07b-e0eac7ebeea6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.443548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.444265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.444601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.445222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.446223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:33.447357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:33.450861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:33.460018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 369/764] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:33.460958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 396/765] 10.222.0.71 () {56 vars in 1124 bytes} [Wed May 18 13:56:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:33.461678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:33.472176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:33.475686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:33.615145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:33.662024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d5489-b0bd-432a-9e1e-945ebef97f92 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.691116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c56d83-e965-483f-ab7e-2e6fa6fd066f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.711293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.711922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.712200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.712469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.713239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:33.713545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:33.715582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:33.723590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 397/766] 10.222.0.71 () {56 vars in 1124 bytes} [Wed May 18 13:56:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:33.724621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:33.759900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.761223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.761803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.762389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.764594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:33.765297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:33.768320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:33.810151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 370/767] 10.222.0.71 () {56 vars in 1149 bytes} [Wed May 18 13:56:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:33.810151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:33.829646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:33.914125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc25f1-bac4-4701-8835-e881316e7467 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:33.992220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:33.994378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:33.995232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:33.996003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] PATH_INFO: `/v3/services/network` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:33.999058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:34.002202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:34.029243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687446f1-88ee-46b5-8789-cf1c2806fb98 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:34.030296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:34.032530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:34.034373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:34.040382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 398/768] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:33 2022] GET /identity/v3/services/network => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:34.042538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:34.097364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:34.115196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:34.116901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:34.117917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:34.118738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:34.122911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] RBAC: Adding query filter params (interface=public, service_id=3e518b7156744fe08cec382fc038a657, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:34.123832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:34.126726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:34.154749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 371/769] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:56:33 2022] GET /identity/v3/endpoints?service_id=3e518b7156744fe08cec382fc038a657&interface=public®ion_id=RegionOne => generated 194 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:34.154749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:34.230270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ff0dd-a58f-4796-a031-a85779915bde None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:34.284299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:34.296244 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:34.298056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:34.298951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:34.299657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:34.362615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb164ae1-ceea-4df8-99d2-2b54db4c7342 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:34.413771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:34.415267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:34.453589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:34.456206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:34.457353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:34.458739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:34.461054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] RBAC: Adding query filter params (name=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:34.462450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:34.468341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:34.484843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 372/770] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:56:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:34.484843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:34.571627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 399/771] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:56:34.572765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:34.611378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:34.620440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:34.678201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cdef0-1dac-4420-b9c6-2fad986cac1e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:34.724245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:34.725592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:34.725592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:34.725592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:34.726509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:34.728001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:34.737949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 373/772] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:56:34 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:34.739450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:34.780986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0b34e-93b9-4c11-82d4-452103ca90bf None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:34.890227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:34.891469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:34.891935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:34.892414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:34.893720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:34.894247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:34.896809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:34.914052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 400/773] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:56:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:34.922923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:34.957205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4a9fb-039d-4209-a871-c6cf9ffe987c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:35.004138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:35.046328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:35.047296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:35.047558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:35.047924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:35.070897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:35.072538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:35.094871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:35.096876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:35.098955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:35.098955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:35.098955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:35.098955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:35.098955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 374/774] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:35.103888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:35.176734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:35.191835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac585ca-48de-4c92-baab-b157ace9c0c1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:35.240843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:35.240843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:35.241199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:35.241509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:35.244868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] RBAC: Adding query filter params (interface=public, service_id=c91f5fafcbd64053a3626dc95b198125, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:35.244868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:35.244868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:35.266663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 401/775] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:56:34 2022] GET /identity/v3/endpoints?service_id=c91f5fafcbd64053a3626dc95b198125&interface=public®ion_id=RegionOne => generated 194 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:35.276381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:35.341679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13b3cc-f5f1-428e-8f0d-11b7b740ce6b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:35.429616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:35.430205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:35.430503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:35.430753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:35.431499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:35.431802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:35.433238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:35.469892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 375/776] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:35.475693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:35.498550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d4f08-f9fa-480c-963c-3190996caf99 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:35.548865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:35.576936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:35.577816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:35.578104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:35.578378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:35.579081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:35.580478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:35.601752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 402/777] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:56:35 2022] GET /identity/v3/services => generated 772 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:35.650568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50330ce-8f3e-4f95-810a-582a2f6e574a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:35.713770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:35.714526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:35.714815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:35.715084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:35.724921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:35.726482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:35.757517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:35.759282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:35.762054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 376/778] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:35.766765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:35.824261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:35.925812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81edf6-7e9d-4479-b4f9-993d4bca25d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:35.972015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:35.972824 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:35.972985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:35.973136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:35.973942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:35.974258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:35.975704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea111106-ea7a-4bf6-91bb-a26da10b226c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:35.989417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 403/779] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:35.998604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:36.120900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1d03-9fd0-4c18-b4a1-f7724b94b9d3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.121272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1d03-9fd0-4c18-b4a1-f7724b94b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.121466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba1d03-9fd0-4c18-b4a1-f7724b94b9d3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.124310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 404/780] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:36.130977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.131334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.131561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.174974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:36.178382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:36.202659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:36.220319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1052f5-7279-41d4-8595-07def8cfd73d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:36.309001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:36.310299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.310583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.310849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.311699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=7881b24eb9e740bb8c74d3e1b2be9428) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:36.312012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:36.319860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf298b72-7496-427b-8dc3-deab3d954f35 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:36.329884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 405/781] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:36.339019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 377/782] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:35 2022] GET /identity/v3/role_assignments?user.id=7881b24eb9e740bb8c74d3e1b2be9428&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:36.355188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:36.373594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:36.414680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba40bb-61c6-43ee-a1cf-219f2c72acc6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.415172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba40bb-61c6-43ee-a1cf-219f2c72acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.415668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba40bb-61c6-43ee-a1cf-219f2c72acc6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.419342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 378/783] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:56:36.427355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.427853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.428352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.475242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dbae5e-a751-4eaf-a011-d1d09b227f80 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:36.498889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:36.500965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:36.516683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:36.517542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.517813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.518098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.531267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:36.539159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:36.542813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 406/784] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:36.548835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:36.634334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:36.670622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d4d00-7dff-4e84-b11a-6da0b125e326 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:36.696811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 379/785] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:36.732233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:36.733480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:36.733973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:36.734456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:36.735450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:36.735970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:36.737726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:36.754409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 407/786] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:36.756275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:36.766204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:36.979445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:37.033165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17d84c-dda3-4327-8419-86e492a0549f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.039159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ebd0d-e186-497e-9fbf-440275ce0d8e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.088629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.089989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.090499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.091543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:37.094364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:37.106679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:37.108616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:37.129648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:37.130631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:37.131528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:37.131528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:37.131528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:37.131528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:37.134072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 408/787] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:37.135127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.135950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.136240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.136512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:37.143942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:37.170551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:37.191108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:37.192165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:37.193072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:37.201919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 380/788] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:37.222509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:37.282276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7677d-4732-420b-8e80-3e91145c3cbc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.335110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.336180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.336686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.337263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:37.338848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:37.339401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:37.342137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:37.367605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 409/789] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:37.379731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:37.469019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:37.480779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880be82-4bcf-410f-8e96-56e8b19e6d88 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.547965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.548654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.548973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.549253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:37.550014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:37.550325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:37.551720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:37.564499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 381/790] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:37.573336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fcc0c-9c50-4435-8aca-12245c07f70e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.573854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:37.603869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:37.622971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.623792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.624075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.624350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:37.643298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:37.644766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:37.668037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:37.670249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:37.672272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 410/791] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:37.677988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:37.801858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1509f-6d64-4ba7-b8a9-8e2455662154 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.812706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:37.851246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.851933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.852218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.852489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:37.853367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:37.853687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:37.855204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:37.887770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f41bd3-d498-449d-9c51-b62a6ba5320f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:37.903563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 411/792] 10.222.0.71 () {56 vars in 1135 bytes} [Wed May 18 13:56:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:37.910138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:37.990256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:37.991079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:37.991362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:37.991631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.025781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:38.030021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:38.046540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470008f6-1f13-4206-a28b-956addee0f52 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:38.069025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:38.070415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:38.071544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:38.071544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:38.071544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:38.071544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:38.077230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 382/793] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 504 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:38.089866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:38.103593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:38.104406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.104685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.104985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.128458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:38.129878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:38.162960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:38.165166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:38.167331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:38.167331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:38.167331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:38.167331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:38.167331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 412/794] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:38.177262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:38.214470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:38.215208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:38.300121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bf8bf-d34b-4693-87bc-328013fb40c0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:38.369790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:38.370475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.370756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.371028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.372390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:38.372708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:38.374123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:38.408127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254232-4fc0-41bc-aa3b-d098ee44d027 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:38.410198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 383/795] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:38.417877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:38.470649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:38.471333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.471617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.471893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.472623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:38.472967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:38.474353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:38.509333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 413/796] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:38.515672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:38.636592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820043a-bb97-48e1-a0b4-447ad025a887 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:38.648312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:38.673494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:38.684177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50d17-dbb8-4702-82e1-33dada8e933f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:38.693517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:38.694338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.694622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.694899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.704681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:38.707100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a2a25786-cac5-4366-b0df-73383a74d881 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:38.726090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:38.728222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:56:38.730322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:38.736839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 384/797] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:56:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:38.736839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64859-9b3d-42b2-b352-d29ac47947b0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.736839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64859-9b3d-42b2-b352-d29ac47947b0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.736839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c64859-9b3d-42b2-b352-d29ac47947b0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.738848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 385/798] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:38.739640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64859-9b3d-42b2-b352-d29ac47947b0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:38.752673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:38.753880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.754169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.754449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.769558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:38.772934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-61021a11-96b6-4bc7-9b18-3221736e3339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:38.796060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:38.798856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 414/799] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:38.805942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:38.807042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:38.821465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:38.822801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:38.935747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 415/800] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:38.936681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:38.941603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c64859-9b3d-42b2-b352-d29ac47947b0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.001639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.002350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.002636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.002917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.003801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:39.004111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.005690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:39.044823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 386/801] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:56:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:39.046562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:39.060292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:39.101462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48207d-aff7-48d9-8b0d-2dbda7712e4d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.118848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:39.146647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.147489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.147788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.148035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.149528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:39.149528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.150732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:39.173477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 416/802] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:39.173477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:39.212102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3f9a0-e549-4aa0-bac3-1713f07d373d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.251916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.252731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.253042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.253310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.253965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.255348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-062ac6fd-a51c-43f5-88d7-d6a61abd114e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:39.269314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:39.270375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 13:56:39.271220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:39.272322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 387/803] 10.222.0.71 () {56 vars in 1129 bytes} [Wed May 18 13:56:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:39.273736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54141e2-42e0-4f81-8a54-a145bf255e24 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.274736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54141e2-42e0-4f81-8a54-a145bf255e24 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.275021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54141e2-42e0-4f81-8a54-a145bf255e24 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.280100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 388/804] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:39.281497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54141e2-42e0-4f81-8a54-a145bf255e24 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:39.355551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8853d2-2664-49cc-84ac-a0f2f957d7c7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.389079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:39.400374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc7cf-63c5-4c82-b839-9ee4d84822e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.402859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc7cf-63c5-4c82-b839-9ee4d84822e1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.402859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc7cf-63c5-4c82-b839-9ee4d84822e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.402859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc7cf-63c5-4c82-b839-9ee4d84822e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.419241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54141e2-42e0-4f81-8a54-a145bf255e24 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.422426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:39.469478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf85642-90f2-47df-b8d2-79a31d046df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.470294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf85642-90f2-47df-b8d2-79a31d046df7 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.470573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf85642-90f2-47df-b8d2-79a31d046df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.470853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf85642-90f2-47df-b8d2-79a31d046df7 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/98fdd10e85dd44e9a952b25557a8236f/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.473069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf85642-90f2-47df-b8d2-79a31d046df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=98fdd10e85dd44e9a952b25557a8236f, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.474577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf85642-90f2-47df-b8d2-79a31d046df7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:39.484753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc7cf-63c5-4c82-b839-9ee4d84822e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.486551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc7cf-63c5-4c82-b839-9ee4d84822e1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:39.543328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 389/805] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:39 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/98fdd10e85dd44e9a952b25557a8236f/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:39.545875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b567eb-c3e3-4aaf-9288-71e9ddab5fbb None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.546161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b567eb-c3e3-4aaf-9288-71e9ddab5fbb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.546442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b567eb-c3e3-4aaf-9288-71e9ddab5fbb None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.547886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 390/806] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:39.552870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b567eb-c3e3-4aaf-9288-71e9ddab5fbb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:39.624380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 417/807] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:56:39.626943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3972d-648f-4973-a46d-d47f018321cf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.627724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3972d-648f-4973-a46d-d47f018321cf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.628394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3972d-648f-4973-a46d-d47f018321cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.655497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9ae3972d-648f-4973-a46d-d47f018321cf None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:39.657026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ae3972d-648f-4973-a46d-d47f018321cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:39.686604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:39.699213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b567eb-c3e3-4aaf-9288-71e9ddab5fbb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.743996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.744586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.744888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.745160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.745978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:39.746282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.747944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:39.749549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 418/808] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:39.752581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.753474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.753998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 391/809] 10.222.0.71 () {56 vars in 1124 bytes} [Wed May 18 13:56:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:39.754364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.754872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:39.781776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:39.783024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:39.794843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:39.883926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 419/810] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:39.888874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:39.913346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74555574-951f-4e4e-a63d-c68db5f644b9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:39.973110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:39.973915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:39.974195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:39.974472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:39.988937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:39.990520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:40.011876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:40.013247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:40.015166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:40.015166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:40.015166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:40.015166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:40.015166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 392/811] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:40.015166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.018015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:40.039405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27c183-882a-4ad6-aee6-348bb298434d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.082781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.084223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.084813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.085288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.086218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:40.086749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.088342 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.097406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 420/812] 10.222.0.71 () {56 vars in 1124 bytes} [Wed May 18 13:56:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:40.099268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.154997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:40.189700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ae6d7-83ef-4b98-8643-0b7b83ac2fda None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.255092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.256385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.256894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.257365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.258473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514554-8751-406c-a4b0-d14c554c30c3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.258659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.260928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:40.282623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:40.284758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:40.286505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 393/813] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:40.288259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.327017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.328301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.328755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.329193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.346598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:40.360886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:40.361899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:40.362775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 421/814] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:40.364151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.381980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:40.432827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2ba4-af4b-4f85-a503-b255a7cda0ee None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.469449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.470132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.470416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.470692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.471421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:40.471727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.473201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.486210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 394/815] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:40.487959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.490608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:40.491968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f7c4-b251-4596-ab9d-296eaa3de55f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.536846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.537425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.537715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.537990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.538730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.540110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.604301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f7cd2-3e42-4458-9cfd-5a1dd49c3bcd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.648603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.649343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.649622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.649893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.650680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:40.651058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.652444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.658635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 395/816] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:40.659473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.677148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 422/817] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:56:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:40.678744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.785391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:40.821009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:40.843770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05876fa-1acc-44bc-97fe-636f6c8955d8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.903992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b310-c19e-43b3-a2a6-e7ec77135900 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:40.906993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.907761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.908112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.908917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.909638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:40.910012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.911515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.928242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 396/818] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:40.929671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:40.955384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:40.956199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:40.956479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:40.956752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:40.965205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:40.967241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:40.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:40.988009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:40.988989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 423/819] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:40.990736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:41.104023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a03169-3199-47d3-8daf-324eb493c68d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:41.144025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:41.153236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13542a3-063e-4e0b-b8b6-82c9b4535b42 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:41.166863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:41.168509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:41.169439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:41.170131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:41.171444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:41.172288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:41.175499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:41.181597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:41.194892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:41.195358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 397/820] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:41.195708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:41.195993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:41.196580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:41.198102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:41.209614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:41.211290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:41.247359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:41.248409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:41.254799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:41.254799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:41.254799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:41.254799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:41.254799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 424/821] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:41.254799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:41.362606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60fc0-8443-4a84-96dc-30d5c192cec7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:41.384276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306cae-95ff-4f21-bee9-03f10e74b7c9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:41.425188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:41.425967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:41.426252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:41.426532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:41.426739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:41.427284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:41.427869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:41.428355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:41.428661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:41.428871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:41.430524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:41.431041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:41.433879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:41.458433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 398/822] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:41.459713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:41.532391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 425/823] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:56:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:41.535786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:41.594941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:41.658260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:41.755536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae57e-b62c-4f78-8198-d1118eab9600 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:41.820064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332bd37-1c21-43b4-b709-f70abf0e6216 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:41.837450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:41.841351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:41.842209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:41.842672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:41.843648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:41.844289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:41.846717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:41.863713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 399/824] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:41.874591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:41.875172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:41.875753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:41.876039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:41.876306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:41.877556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=bd1a4928c641445e8b78a2836c680536) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:41.878303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:41.880196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc732697-6f50-4ecc-9d66-0df6937ce8da None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:41.891420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 426/825] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:41 2022] GET /identity/v3/role_assignments?user.id=bd1a4928c641445e8b78a2836c680536&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:42.059143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d841e8c-2cf6-4701-a208-7b703af62f9b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.073726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:42.108277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.109159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.109503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.109864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.111570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3edfa-8e08-4160-aa82-9b84868a58d8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.111868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3edfa-8e08-4160-aa82-9b84868a58d8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.112153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3edfa-8e08-4160-aa82-9b84868a58d8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.113623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 427/826] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:42.120472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.120774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.121297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.123731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:42.125456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:42.142193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:42.143410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:42.143514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:42.144386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:42.146623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 400/827] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:56:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:42.152194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.261959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 428/828] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:56:42.292040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.313724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882f721-4518-4435-a5a2-9e3ab7798649 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.334508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:42.381435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.383309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.384428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.385836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.388776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:42.389961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:42.393154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:42.424723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 401/829] 10.222.0.71 () {56 vars in 1149 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:42.431263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.444382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7964219-8835-43bd-89fa-bc663b33b787 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.465057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:42.491405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.492204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.492488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.492761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.507692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:42.517141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:42.519035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:56:42.520813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:42.523361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 429/830] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:42.524523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.573141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc70f5-c974-4de7-ad8c-aa8cbdd7767d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.631738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.632435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:42.633674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.634246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.634728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.651629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:42.654611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:42.657016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f003-07aa-4ff4-a9c3-1c79b01ea39f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:42.682542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:42.684904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:42.686703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:42.686703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:42.686703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:42.686703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:42.690925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 402/831] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:42.696708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.704767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.705987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.706495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.706999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.708436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:42.709056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:42.711656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:42.733290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 430/832] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:42.735897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.828881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:42.870236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70121611-738c-49c9-b0d1-a586d7840e3c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.875189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce7f7a-6e21-4389-9d41-1d3521f9ec20 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:42.931469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.932176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.932458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.932736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.933525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:42.933859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:42.935355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:42.942343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:42.945178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:42.946965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:42.948012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:42.952960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 403/833] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:42.958252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:42.970668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:42.972458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:42.992631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:42.994679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:43.005845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:43.005845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:43.005845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:43.005845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:43.005845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 431/834] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:43.005845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:43.009788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:43.135750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc262690-d3aa-49a2-a1f9-0ecd2eae3b3d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:43.188967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:43.190286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.191192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.191695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.202826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:43.205472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:43.208134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:43.214252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49715ca8-76d4-42b8-9c83-07434f3338bd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:43.225998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:43.234011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:43.234905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:43.237856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 404/835] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:43.239151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:43.300983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:43.302283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.302843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.303393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.305091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:43.305708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:43.308350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:43.340280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 432/836] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:43.342489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:43.390219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bebc09-0abc-4fde-9d1c-4b776d00d447 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:43.439501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:43.440179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.440452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.440759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.441594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:43.441901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:43.443369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cff716-3b8d-4e22-aeb9-e7dfe4894e7e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:43.445759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:43.464630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 405/837] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:43.464630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7879-791c-4884-add3-0654d6afeb68 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.464630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7879-791c-4884-add3-0654d6afeb68 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.464630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7879-791c-4884-add3-0654d6afeb68 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.464630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 406/838] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:43.466110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7879-791c-4884-add3-0654d6afeb68 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:43.540659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326bdff-2982-4fcc-9a82-2f59b9004873 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:43.541218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:43.601874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:43.603203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.603689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.604173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.618728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:43.621080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:43.627416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7879-791c-4884-add3-0654d6afeb68 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1cff18bf-3394-45ff-931f-82dd9949712d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:43.649179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:43.651093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 13:56:43.653410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:43.659200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 433/839] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:56:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:43.661693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.662192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.662845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.678625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:43.679528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:43.679803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:43.680074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/7881b24eb9e740bb8c74d3e1b2be9428/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:43.691355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:43.693385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:43.700594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=7881b24eb9e740bb8c74d3e1b2be9428, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:43.702142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:43.787464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 434/840] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:43.788892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:43.789952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 407/841] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:56:43 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/7881b24eb9e740bb8c74d3e1b2be9428/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:56:43.830026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:43.909873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:44.037029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30540b-1245-4017-b859-ce7bdb20cad9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:44.048327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5f484-6273-4ad1-a2d1-ba42f7445299 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:44.069849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:44.109519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:44.110164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.110449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.110744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.112591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:44.112591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:44.113358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:44.126266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:44.127918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.128532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.129197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.130516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:44.134023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:44.138175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 435/842] 10.222.0.71 () {56 vars in 1135 bytes} [Wed May 18 13:56:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:44.146406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:44.161091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:44.162207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:44.163091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:44.164046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 408/843] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:44.175589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:44.302802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f93bc-ad8f-4fe1-8410-8c7aea8fc650 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:44.305908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:44.333795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5e190-ddb7-4da2-89ea-535e05fb9a04 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:44.354672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:44.355455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.356579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.357224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.390597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:44.392161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.392633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.393113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.394237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:44.395173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:44.397198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:44.405183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 409/844] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:44.414009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:44.451770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:44.453689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:44.460383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:44.545318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a2fb4-cdbb-4c66-aeb4-ae5d8edf19a0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:44.574092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 436/845] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 13:56:44.582575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:44.586227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:44.592356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:44.593072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.593349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.593617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.594324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:44.594625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:44.596284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9606e3d-0058-48f8-ac75-d8c48a026669 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:44.607989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 410/846] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:44.645749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcba1b-22e3-4799-bc38-6b02e34ff3b9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.646226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcba1b-22e3-4799-bc38-6b02e34ff3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.646684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcba1b-22e3-4799-bc38-6b02e34ff3b9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.650124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 411/847] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:44.659359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.659802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.660231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.691896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:44.693923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:44.784549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491efabf-5113-4f78-9c3a-82d9a0b729b9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:44.832131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 412/848] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:44.856093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:44.867509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:44.869699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:44.869699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:44.869900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:44.894372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:44.897301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:44.931727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:44.932870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:44.934470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:44.934470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:44.934470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:44.934470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:44.935500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 437/849] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:44.940265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:44.945793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:45.057456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:45.065358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd09f8d-389b-47d9-9b68-8bc3e6bc76ab None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:45.138299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:45.139636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:45.140096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:45.140553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:45.141980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:45.144439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:45.148456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e771c4-71c8-4dd7-b2b1-a1da0eb8e09a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:45.166827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:45.170153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:45.172188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 413/850] 10.222.0.71 () {56 vars in 1132 bytes} [Wed May 18 13:56:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:45.176958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:45.216274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:45.217256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:45.217724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:45.218248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:45.219561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:45.220258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:45.222813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:45.257183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 438/851] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:45.260470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:45.375422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:45.389448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b48c258-8c33-429e-9e8e-d2151d105709 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:45.455990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bfa05-e71d-47ea-bc9a-50aacaf13a60 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:45.457647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:45.459046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:45.459805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:45.460512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:45.462090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:45.462914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:45.465697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:45.475224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 414/852] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:45.483686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:45.483921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:45.523520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:45.524323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:45.524866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:45.525353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:45.539683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:45.542446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:45.570229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:45.571456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:45.572476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:45.577147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 439/853] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:45.582468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:45.610473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a334a9-00de-4e68-8243-6f02c70beaf0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:45.651402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:45.652479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:45.653675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:45.654179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:45.655096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:45.655603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:45.657238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:45.668958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 415/854] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:45.791947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99830630-c77d-4383-9153-c3caf3f7a45f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:45.863223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:45.864392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:45.864936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:45.865436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:45.867037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:45.867600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:45.870418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8bdbc-e1fa-47e9-bb89-462628db8e45 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:45.895442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 440/855] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:45.905500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:45.955959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:46.081320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b9d67-34d9-4441-962e-8c8012c926bf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:46.122882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:46.123959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:46.124447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:46.124965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:46.126015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=98fdd10e85dd44e9a952b25557a8236f) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:46.126524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:46.128185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af996b1-f873-40da-946b-31f9f6e32ca0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:46.135687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 416/856] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:45 2022] GET /identity/v3/role_assignments?user.id=98fdd10e85dd44e9a952b25557a8236f&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:47.495533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650eb3b-9596-4764-abea-8038cb887758 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:47.497013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650eb3b-9596-4764-abea-8038cb887758 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:47.497013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650eb3b-9596-4764-abea-8038cb887758 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:47.499110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 441/857] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:56:47.508213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:47.509726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:47.510509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:47.539991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:47.541268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:47.626212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 417/858] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:47.666003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650eb3b-9596-4764-abea-8038cb887758 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:47.733587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:47.872263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650eb3b-9596-4764-abea-8038cb887758 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:47.937985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad11e63-0a69-4488-a4c0-e40bd6939fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:47.939336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11e63-0a69-4488-a4c0-e40bd6939fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:47.939779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11e63-0a69-4488-a4c0-e40bd6939fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:47.940258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad11e63-0a69-4488-a4c0-e40bd6939fc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:47.960499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad11e63-0a69-4488-a4c0-e40bd6939fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-aad11e63-0a69-4488-a4c0-e40bd6939fc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:47.976839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:47.977987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:56:47.978919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:47.979588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 442/859] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:56:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:47.987693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:47.998932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a16b-5537-48dc-a618-fd4fb47092f2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:47.999424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a16b-5537-48dc-a618-fd4fb47092f2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:47.999900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a16b-5537-48dc-a618-fd4fb47092f2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.003082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 443/860] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:48.009074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.009562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.010041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.013062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:48.040444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:48.042736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:48.111801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30f27f-efb5-40fd-aec3-8ed7230b4feb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:48.153532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:48.154802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.155398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.155896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.156960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:48.157578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:48.159216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:48.170301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 418/861] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:48.178502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:48.187560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 444/862] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:56:48.209923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:48.251448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:48.347884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:48.357032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cd6a6-2623-4c5e-b1cb-5e7e46566b29 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:48.393068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9796-c213-4241-bc85-f83672849a08 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:48.409956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcc1d9-8de4-4da7-aad8-a28bb0a76d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:48.411029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc1d9-8de4-4da7-aad8-a28bb0a76d30 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.411503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc1d9-8de4-4da7-aad8-a28bb0a76d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.412030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcc1d9-8de4-4da7-aad8-a28bb0a76d30 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.413348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcc1d9-8de4-4da7-aad8-a28bb0a76d30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:48.415259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbcc1d9-8de4-4da7-aad8-a28bb0a76d30 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:48.445398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:48.446195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.446565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.446982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.462927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:48.464384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9c69aa73-ef48-4d4d-8aad-3684638e0d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:48.483570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:48.493333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 419/863] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc7d4-1f94-4ecf-82de-803b998e0b3f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc7d4-1f94-4ecf-82de-803b998e0b3f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc7d4-1f94-4ecf-82de-803b998e0b3f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.494977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 420/864] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:48.495929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc7d4-1f94-4ecf-82de-803b998e0b3f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:48.522196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 445/865] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:56:48 2022] POST /identity/v3/services => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:56:48.527056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.527056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.527772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.567619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:48.572429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:48.697033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc7d4-1f94-4ecf-82de-803b998e0b3f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:48.717480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 446/866] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:48.736888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:48.741332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:48.754714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:48.762820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.762820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.762820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.762820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:48.762820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:48.763551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:48.769211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:48.787492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 421/867] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:48.798015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:48.921799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb102a58-7b60-4f3e-b540-70114dd113db None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:48.947717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706194-5f04-4a62-98b2-d565a0a36dbd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:48.982851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69464f24-3a23-4bb4-845a-d186484e16a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:48.983876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464f24-3a23-4bb4-845a-d186484e16a4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.984356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464f24-3a23-4bb4-845a-d186484e16a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.984665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69464f24-3a23-4bb4-845a-d186484e16a4 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.985706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464f24-3a23-4bb4-845a-d186484e16a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:48.987486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69464f24-3a23-4bb4-845a-d186484e16a4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:48.988472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:48.989508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:48.989952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:48.990456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:48.998914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:49.000387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:49.017795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:49.019795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:49.022250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:49.023928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 422/868] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:56:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:49.024976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:49.077991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 447/869] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:56:48 2022] POST /identity/v3/services => generated 269 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:49.110051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:49.223212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950bfce-3d51-4c3d-bf99-6dab76722e11 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:49.280753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b731c3a-1e5e-4ae1-b525-4a9f1f44f3f4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:49.281101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b731c3a-1e5e-4ae1-b525-4a9f1f44f3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:49.281372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b731c3a-1e5e-4ae1-b525-4a9f1f44f3f4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:49.287330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 448/870] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:56:49.289413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:49.289632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:49.289807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:49.309226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:49.310463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:49.310843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:49.311133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:49.311996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:49.312308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:49.314784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:49.323426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:49.323665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:49.351877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 423/871] 10.222.0.71 () {56 vars in 1149 bytes} [Wed May 18 13:56:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:49.360281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:49.428993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 449/872] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:56:49.451255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:49.454865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:49.510143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:49.514734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc6bea-6136-47e1-81fa-0106c95c1fe5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:49.557403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:49.559363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:49.559913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:49.560739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:49.570413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b59c-09e8-4797-b4e9-d376b478ebc1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:49.633406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:49.635637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:49.636208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:49.638236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:49.639981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:49.644310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:49.654712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:49.656491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:49.666793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:49.667870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:56:49.669327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:49.672364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 450/873] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:49.682526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:49.790146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:49.799911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:49.810334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 424/874] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 13:56:49.812046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:49.838589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761ee54-383f-45d1-a5b4-713f65c6b0cc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:49.890423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:49.891821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:49.892401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:49.892918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:49.894019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:49.894532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:49.896243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:49.903061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 451/875] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:56:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:49.912279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:49.959094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502358-bc27-4540-9499-0de57b9a5d74 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:50.014654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:50.015523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:50.016196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:50.016474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:50.031589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:50.034491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:50.055058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:50.057294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:50.059605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:50.059605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:50.059605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:50.059605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:50.061317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 425/876] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:50.063001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:50.078036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897a8f-fb61-4552-9300-92b073459675 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:50.115566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:50.123155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:50.124190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:50.124708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:50.125204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:50.126073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:50.126544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:50.141092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:50.141092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 452/877] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:56:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:50.162049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:50.217432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b6fb-4969-458a-b66f-d8c09ff4371d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:50.268448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:50.269408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:50.269769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:50.270049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:50.270788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:50.271098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:50.272677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:50.300730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 426/878] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:50.306424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:50.491084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671d27d-b455-4e15-a6da-c451c2aaecf8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:50.558033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:50.560871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:50.561651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:50.562410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:50.576046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:50.580127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:50.609448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:50.611105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:50.612896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:50.617282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 453/879] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:50.627023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:50.810090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf912e-2e13-4edd-a53e-b2700759c036 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:50.835301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:50.873556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:50.874673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:50.875154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:50.875627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:50.877105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:50.877640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:50.880282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9f080-f570-4904-ba40-ab686787b84b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:50.905627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 427/880] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:50.911312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:50.975250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:51.049290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457747-7706-4408-b788-dc42cd643e3d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:51.093334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:51.094311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.094735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.095153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.096129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=7881b24eb9e740bb8c74d3e1b2be9428) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:51.096907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:51.098582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b1e1d-541b-4a1d-9b0f-957fb8ef23db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:51.106342 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 454/881] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:50 2022] GET /identity/v3/role_assignments?user.id=7881b24eb9e740bb8c74d3e1b2be9428&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:51.203414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44987e-6502-471d-a862-c4b64f48a48d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.203874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44987e-6502-471d-a862-c4b64f48a48d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.204420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44987e-6502-471d-a862-c4b64f48a48d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.206251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 428/882] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:51.213465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f81bd-a91a-4f2e-bf96-b1b90ae7c79d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.214215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f81bd-a91a-4f2e-bf96-b1b90ae7c79d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.214989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f81bd-a91a-4f2e-bf96-b1b90ae7c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.248191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6c0f81bd-a91a-4f2e-bf96-b1b90ae7c79d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:51.250696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c0f81bd-a91a-4f2e-bf96-b1b90ae7c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:51.379043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 455/883] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:51.403429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44987e-6502-471d-a862-c4b64f48a48d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:51.522550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5837a97-b515-4cc7-9de2-a1fff5b9fcc8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.522822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5837a97-b515-4cc7-9de2-a1fff5b9fcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.523172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5837a97-b515-4cc7-9de2-a1fff5b9fcc8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.524668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 456/884] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:51.532499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.532779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.533090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.538463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44987e-6502-471d-a862-c4b64f48a48d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:51.551691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:51.553273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:51.581702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:51.582509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.582873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.583157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.583818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:51.585359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:51.600598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:51.602058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:51.602924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 429/885] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:51.606717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:51.649286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:51.672603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:51.688955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 457/886] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:56:51.708704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:51.772190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5d2e1-5a8e-4640-8487-cd6ae20c6d1d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:51.810460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:51.811259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.811499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.811677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.812398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:51.812710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:51.814146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:51.819950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 430/887] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:51.827595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:51.877127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43025ca-d373-45a3-87c6-ecdb20f1cde1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:51.919797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:51.921206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:51.921721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:51.922703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:51.923579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:51.925566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:51.942697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:51.943735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:51.944587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:51.952635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 458/888] 10.222.0.71 () {56 vars in 1132 bytes} [Wed May 18 13:56:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:51.956561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:51.957912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:51.961911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275527d-8023-4f8b-8d39-05f80932b89a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.013134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:52.014616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:52.015130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:52.015645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:52.016946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:52.017468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:52.019416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:52.029833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 431/889] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:52.035705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:52.044674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:52.128053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815040e1-c0fc-45ee-a036-23a8fb317479 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.186448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:52.188130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:52.188824 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:52.189950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:52.192302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:52.193443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:52.197312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:52.210021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 459/890] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:52.217097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:52.246667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273a77-432b-4a85-a803-4061c2156777 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.303228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:52.304428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:52.304913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:52.305364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:52.306336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] RBAC: Adding query filter params (interface=public, service_id=312f282624ab4b5ea852af1153096816, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:52.306839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:52.308451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:52.317239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 432/891] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:56:52 2022] GET /identity/v3/endpoints?service_id=312f282624ab4b5ea852af1153096816&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:52.326807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:52.386351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:52.413161 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e9681-15c3-4f22-8f43-5e9ebe474810 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.432108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:52.482826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:52.483829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:52.484301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:52.484766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:52.486060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:52.486574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:52.488978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:52.500087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 460/892] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:52.504742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:52.579738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8815-e8ee-412e-b9a7-e865b9f8dc7a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.649161 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e65ee-912f-4589-9476-59507f0b4967 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.668420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:52.670877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:52.672164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:52.673162 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:52.674867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:52.678462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:52.689836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 433/893] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:56:52 2022] GET /identity/v3/services => generated 1268 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 13:56:52.717854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:52.719752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:52.720395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:52.721036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:52.722545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] RBAC: Adding query filter params (interface=public, service_id=519f2a8803db476db2b02a53ced68246, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:52.723304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:52.725935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74111527-1960-4e14-aa45-2f613304c6c4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:52.737413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 461/894] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:56:52 2022] GET /identity/v3/endpoints?service_id=519f2a8803db476db2b02a53ced68246&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:52.746713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:52.935166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:52.952222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d2ae-045c-4664-81b2-c2ed73f08139 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:52.999816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415ec6f-fe36-4bbb-80e4-89649d62bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:53.000415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec6f-fe36-4bbb-80e4-89649d62bc07 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:53.000700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec6f-fe36-4bbb-80e4-89649d62bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:53.001013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415ec6f-fe36-4bbb-80e4-89649d62bc07 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:53.001721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415ec6f-fe36-4bbb-80e4-89649d62bc07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:53.003182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415ec6f-fe36-4bbb-80e4-89649d62bc07 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:53.010629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 434/895] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:56:52 2022] GET /identity/v3/services => generated 1268 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 13:56:53.093957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eed68-eae2-4ec4-9dbd-e8230798f206 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:53.094495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eed68-eae2-4ec4-9dbd-e8230798f206 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:53.094971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eed68-eae2-4ec4-9dbd-e8230798f206 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:53.100128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 462/896] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:53.107947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f927fc-b557-4f46-9025-b85d4bc1fda2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:53.108435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f927fc-b557-4f46-9025-b85d4bc1fda2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:53.108984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f927fc-b557-4f46-9025-b85d4bc1fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:53.140203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f6f927fc-b557-4f46-9025-b85d4bc1fda2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:53.142679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f6f927fc-b557-4f46-9025-b85d4bc1fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:53.293518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 435/897] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:56:53.330390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eed68-eae2-4ec4-9dbd-e8230798f206 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:53.401496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:53.535667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eed68-eae2-4ec4-9dbd-e8230798f206 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:53.578187 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65468c25-3347-446e-8668-1287e585ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:53.579243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468c25-3347-446e-8668-1287e585ebb4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:53.579721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468c25-3347-446e-8668-1287e585ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:53.580189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468c25-3347-446e-8668-1287e585ebb4 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:53.581158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65468c25-3347-446e-8668-1287e585ebb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:53.582753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65468c25-3347-446e-8668-1287e585ebb4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:53.672238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 463/898] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:56:53 2022] POST /identity/v3/services => generated 241 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:54.174751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429417-3ab2-4add-b4d2-5ddfea01af75 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:54.175749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429417-3ab2-4add-b4d2-5ddfea01af75 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:54.176222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429417-3ab2-4add-b4d2-5ddfea01af75 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:54.178188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 436/899] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:56:54.185154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:54.186127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:54.186601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:54.205467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:54.207005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:54.330380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 464/900] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:54.373736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429417-3ab2-4add-b4d2-5ddfea01af75 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:54.547349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:54.578553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429417-3ab2-4add-b4d2-5ddfea01af75 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:54.657940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:54.659864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:54.660649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:54.661414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:54.683855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:56:54.701420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:54.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:56:54.704395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:54.708859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 437/901] 10.222.0.71 () {56 vars in 1120 bytes} [Wed May 18 13:56:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:54.716277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:54.763885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:54.910366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ec76f-27ee-4ac1-8c88-5fc81693c982 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:54.965777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:54.967416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:54.968204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:54.969017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:54.970772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:54.971639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:54.974509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:54.993598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 465/902] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:56:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:55.004160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:55.211848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645e10a-f3ce-4b31-a7e2-2ab3f9a6cb47 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:55.275850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:55.277768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:55.278592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:55.279354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:55.299801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:55.302952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:55.317193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0fbe9373-eb55-4ed1-95c1-0493c948dd47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:55.340494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:55.341504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:55.342397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:55.342397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:55.342397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:55.342397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:55.344705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 438/903] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:55.352537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:55.530763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:55.562691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee0392-edcd-4c19-8653-eb55fdc3c72b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:55.614142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2ef86-5306-46d0-9fca-194cd7ea58aa None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:55.614806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2ef86-5306-46d0-9fca-194cd7ea58aa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:55.615402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2ef86-5306-46d0-9fca-194cd7ea58aa None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:55.617542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 439/904] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:56:55.624012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:55.624316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:55.624567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:55.633453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:55.634527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:55.635025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:55.635512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:55.636958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:55.637515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:55.641614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:55.644045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:55.645364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:55.671930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 466/905] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:55.680213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:55.733180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 440/906] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:56:55.753896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:55.868565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ab44-af03-4791-b278-6afd36b285f6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:55.888549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02863-f305-4800-83a6-668f6a60493c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:55.912859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:55.917070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:55.918591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:55.919370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:55.919851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:55.921751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:55.923881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:55.944607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:55.945835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 13:56:55.946756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:55.952465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 441/907] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:55.955210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:55.962688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:55.963934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:55.964446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:55.965638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:55.977665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:55.980644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:56:56.013962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:56.015002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:56:56.016241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:56.024323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 467/908] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:56:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:56:56.025677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:56.031032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:56.112239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c4918-fb94-46ee-9c5f-994bfe5deade None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:56.155618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:56.156397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.156574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.156890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.157611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:56.157917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:56.159318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578c0f8-6dfc-4321-a7dc-8b390dceb7af None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:56.169438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 442/909] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:56.169638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97612e9-ba5e-4103-8f81-2742cc871513 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:56.169736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0685-0ad5-4ae2-9b8c-69c8cb9266a0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.169736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0685-0ad5-4ae2-9b8c-69c8cb9266a0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.169736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0685-0ad5-4ae2-9b8c-69c8cb9266a0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.169736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 443/910] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:56.171903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0685-0ad5-4ae2-9b8c-69c8cb9266a0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:56.221731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:56.222872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.224141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.224592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.226107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:56.226628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:56.231187 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b662d0-ff88-43c4-9a9f-e62e988f79a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:56.264188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:56.268774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 468/911] 10.222.0.71 () {56 vars in 1149 bytes} [Wed May 18 13:56:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:56.271038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.271508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.271969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.301853 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:56.303815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:56.337153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0685-0ad5-4ae2-9b8c-69c8cb9266a0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:56.397070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:56.397949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.398446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.398935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.400253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:56.400828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:56.404092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:56.413592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 444/912] 10.222.0.71 () {56 vars in 1114 bytes} [Wed May 18 13:56:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:56:56.415004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:56.421521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:56.439988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 469/913] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:56.441219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:56.576881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb03fe-ab13-413b-96cb-7e123f540695 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:56.587408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d798b0-0051-498c-b69e-9b7fb6988581 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:56.603737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:56.623780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef82f41-7e25-4d8c-bcd0-c233e778a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:56.624616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82f41-7e25-4d8c-bcd0-c233e778a68e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.625146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82f41-7e25-4d8c-bcd0-c233e778a68e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.625592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef82f41-7e25-4d8c-bcd0-c233e778a68e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.632701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:56.633396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.633669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.633950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.634688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:56.636045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:56.709647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef82f41-7e25-4d8c-bcd0-c233e778a68e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:56.711147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef82f41-7e25-4d8c-bcd0-c233e778a68e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:56.736435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 470/914] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:56:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:56.738321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:56.836482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:56.900408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 445/915] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:56:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:56:56.904046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa9314-ea30-40ee-80bd-0f159d3470e7 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:56.904821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa9314-ea30-40ee-80bd-0f159d3470e7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:56.905276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa9314-ea30-40ee-80bd-0f159d3470e7 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:56.908045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 446/916] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:56.914432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa9314-ea30-40ee-80bd-0f159d3470e7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:56.947372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ed55-5200-44ae-a771-c52e1cb7203a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:56.956303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:57.013699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.014521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.014971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.015436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.016819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.019481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7291ae5f-fb9b-40c6-a287-539d86fde09c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:57.040747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:57.041826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 13:56:57.043252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:56:57.044060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 471/917] 10.222.0.71 () {56 vars in 1132 bytes} [Wed May 18 13:56:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:57.048875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.048875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.048875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.075400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:56:57.077114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:56:57.110925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa9314-ea30-40ee-80bd-0f159d3470e7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.157504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.158825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.159277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.159729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.189064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 472/918] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:56:57.189064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.191397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.193470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:56:57.231386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:57.232398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:57.233349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:56:57.233349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:56:57.233349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:56:57.233349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:57.235724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 447/919] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:57.236895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.269455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:57.330497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:57.351663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b25a1-052e-4d9d-8049-7b1595dc2946 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.376026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201f979-244e-499d-88d9-1621a4741291 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.398651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.399333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.399610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.399887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.400776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:57.401115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.403089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.416412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 473/920] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:57.416412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.429446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.430970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.431548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.432059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.433370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.436058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:57.451803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:57.453034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:57.453918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 448/921] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:57.454762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.541446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef5546-49f0-4b12-a28b-39cee1223621 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.543452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:57.597531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.601177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.601737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.602102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.603396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:57.603923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.606765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.629437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 474/922] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:57.631076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.640592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5ac0-5555-4c88-862e-0da7e294ada7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.688487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.689193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.689487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.689747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.690739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:57.691036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.692585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.695411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:57.711061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 449/923] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:57.711061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.825614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7748a-4d7a-4efe-9a82-3466000f7c31 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.879083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90c72e-6b65-4798-b810-7bcc70ad2ba8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:57.897086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.898262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.898728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.899218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.900964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:57.901140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.903675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.920882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 475/924] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:57.920882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:57.938171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:57.939000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:57.939651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:57.939940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:57.949434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:57.951342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:57.965639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:56:57.967384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:56:57.969143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 450/925] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:56:57.971586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:58.054922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:58.106322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c9872-1786-449e-90b5-632f72d55054 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:58.111402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f908b1-3e5d-4005-8f6d-743bf7cb1908 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:58.159982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:58.160663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:58.160984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:58.161260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:58.161977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:58.162317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:58.163689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:58.178477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 451/926] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:56:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:58.178477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:58.182377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:58.183757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:58.184261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:58.184723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:58.187135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:58.189549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:58.321022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 476/927] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:56:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:56:58.322944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:58.349537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef8999-c0ca-4768-a427-89657f69a563 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:58.431445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:58.433288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:58.434030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:58.434845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:58.436654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:58.437606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:58.440727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:58.468466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba464c1-f1c8-4963-9659-cc744c449fc0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:58.469467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:58.469592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:56:58.469680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 452/928] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:56:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:58.473691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:58.515267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:58.516243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:58.516525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:58.516818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:58.518317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] RBAC: Adding query filter params (interface=public, service_id=14e7b6b802084ffbbd8921e1affdef7e, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:58.518662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:58.520125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:58.532723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 477/929] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:56:58 2022] GET /identity/v3/endpoints?service_id=14e7b6b802084ffbbd8921e1affdef7e&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:58.537476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:56:58.651258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dcb35-4131-4ec9-af03-b2da72a0e72d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:58.679632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c9d2b-9f1b-4ac4-8b25-2eb2dcb902c5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:56:58.728458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:58.730976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:58.731494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:58.731986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:58.733948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] RBAC: Adding query filter params (role.id=d64cb70e7b5f4c6482648ed37df3ef1c, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=7881b24eb9e740bb8c74d3e1b2be9428) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:56:58.734620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:58.737523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56ff2-dae0-4775-b5d8-8a672a15c060 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:58.737759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c9430-c421-45e2-9f9e-79a6f9b39082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:56:58.738978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c9430-c421-45e2-9f9e-79a6f9b39082 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:58.739610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c9430-c421-45e2-9f9e-79a6f9b39082 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:58.740144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c9430-c421-45e2-9f9e-79a6f9b39082 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:58.741622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c9430-c421-45e2-9f9e-79a6f9b39082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:56:58.744308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c9430-c421-45e2-9f9e-79a6f9b39082 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:56:58.749816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 453/930] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:56:58 2022] GET /identity/v3/role_assignments?user.id=7881b24eb9e740bb8c74d3e1b2be9428&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=d64cb70e7b5f4c6482648ed37df3ef1c => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:56:58.757471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 478/931] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:56:58 2022] GET /identity/v3/services => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 13:56:59.969601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db54e6-d64a-4cb2-b5fe-843ff3964560 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:59.970606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db54e6-d64a-4cb2-b5fe-843ff3964560 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:59.971120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db54e6-d64a-4cb2-b5fe-843ff3964560 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:59.973004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 454/932] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:56:59.979092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:56:59.980112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:56:59.980598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:56:59.999406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:00.001110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:00.005588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:00.077964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 479/933] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:56:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:00.101825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db54e6-d64a-4cb2-b5fe-843ff3964560 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:00.185480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:00.295371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db54e6-d64a-4cb2-b5fe-843ff3964560 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:00.360281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:00.363186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:00.363186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:00.363186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:00.363466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:00.365818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:00.368111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING keystone.server.flask.common [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 13:57:00.441652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.sql.core [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 13:57:00.441652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 13:57:00.441652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [parameters: {'id': '96bd19ee882d4147b7f15345e172a629', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 13:57:00.441652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80330) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96bd19ee882d4147b7f15345e172a629.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96bd19ee882d4147b7f15345e172a629. May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 13:57:00.458059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 18 13:57:00.459639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return project_ref.to_dict() May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application yield resource May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.rollback() May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.force_reraise() May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise self.value May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application session.commit() May 18 13:57:00.461541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._prepare_impl() May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.flush() May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._flush(objects) May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application compat.raise_( May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application flush_context.execute() May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 13:57:00.463351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rec.execute(self) May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 13:57:00.467699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 13:57:00.474910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [parameters: {'id': '96bd19ee882d4147b7f15345e172a629', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:00.477961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:00.481662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.Conflict( May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96bd19ee882d4147b7f15345e172a629. May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:00.494570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 455/934] 10.222.0.71 () {60 vars in 1140 bytes} [Wed May 18 13:57:00 2022] POST /identity/v3/projects => generated 262 bytes in 359 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:00.500258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:00.689359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62e465-9fa8-4019-81b0-52bace1afc48 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:00.757885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:00.759779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:00.760565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:00.762087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:00.775658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:00.779582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:00.785166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9ebb7431-8f3e-4489-9d2f-0bf71327bf9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:57:00.809540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:00.811349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:00.813212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:00.818488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 480/935] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:00.829388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:01.063808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148623-68f8-4677-ab42-96a1512d3156 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:01.067940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:01.153433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:01.155139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.155925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.156698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.158525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:01.159385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:01.170175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd3911-2d54-4e86-9eeb-7bbd8ef9af02 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:01.199500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 456/936] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:01.363143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd193d3-e9b8-4541-867a-3b6c7dca650a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.363143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd193d3-e9b8-4541-867a-3b6c7dca650a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.363143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd193d3-e9b8-4541-867a-3b6c7dca650a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.364248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 481/937] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:01.372737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.373078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.373324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.399199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:01.400844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:01.488848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 457/938] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:01.524998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd193d3-e9b8-4541-867a-3b6c7dca650a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:01.663095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd193d3-e9b8-4541-867a-3b6c7dca650a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:01.707838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:01.708702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.709024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.709301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.710001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:01.711486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9ee61e28-ecac-4060-8799-881aa283635c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:01.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:01.726410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:01.727734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 482/939] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:57:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:01.734528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:01.768413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6a76-f518-4443-8e81-5af65e633d6c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.768413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6a76-f518-4443-8e81-5af65e633d6c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.768413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6a76-f518-4443-8e81-5af65e633d6c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.768413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 483/940] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:01.775230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.775851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.776332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.796002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:01.797881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:01.845089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:01.860921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7efd5-203e-45f0-8d5b-def3b2f54bd1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:01.889597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:01.900313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 484/941] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:01.913692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:01.914311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:01.914601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:01.914878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:01.915606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:01.915911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:01.921069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:01.926261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 458/942] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:57:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:01.931037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:01.932285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.051254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2566658-8d8e-470a-a26a-5aa7badbd818 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.053808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e375dc7-421c-4fdc-905a-dd8814ee1447 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.089000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74cefd-b811-4ca8-92da-7692abec2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.090898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cefd-b811-4ca8-92da-7692abec2a0d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.091062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cefd-b811-4ca8-92da-7692abec2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.091277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cefd-b811-4ca8-92da-7692abec2a0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.102675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74cefd-b811-4ca8-92da-7692abec2a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4b74cefd-b811-4ca8-92da-7692abec2a0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:02.112019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:02.113066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:02.113930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 485/943] 10.222.0.71 () {56 vars in 1120 bytes} [Wed May 18 13:57:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:02.114630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e04c-25d9-47ec-8ddc-21a467b064a4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.115345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e04c-25d9-47ec-8ddc-21a467b064a4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.115345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6e04c-25d9-47ec-8ddc-21a467b064a4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.116677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 486/944] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:02.122709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.122994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.123210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.123936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.124073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.124206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.124632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.125197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:02.125503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:02.126881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:02.134087 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 459/945] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:57:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:02.141058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.142022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:02.143656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:02.163818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:02.238623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:02.256432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 487/946] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:02.257815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.279075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c4ff-7310-4186-8ebf-92df57bb1409 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.337997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.339033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.339377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.340021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.341545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:02.342049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:02.344417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:02.363866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 460/947] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:57:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:02.363866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.423158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da1b3-5838-4d42-b7d5-f0ded576fd0c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.469163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.470005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.470284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.470552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.471309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:02.473556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:02.487682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:02.507995 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f5cc-d489-4668-9fad-def64a379008 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.546142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.546984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.547269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.547541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.548323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:02.549812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:02.563296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 488/948] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:57:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:02.564517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:02.568417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:02.569763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:02.570666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:02.571531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 461/949] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:02.579525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.626674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:02.728251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c25f8-0622-4e42-bab7-7f32a0bb542d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.789782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169e4a9-efc3-4ea2-bc21-3d7c2d5aa61c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:02.794077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.796189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.796646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.797100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.814094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:02.816776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:02.851374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:02.852325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:02.852778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:02.854363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:02.854497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:02.856200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:02.857332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:02.858454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:02.859450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:02.859450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:02.859450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:02.859450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:02.859694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:02.860271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 489/950] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:02.869483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.869853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 462/951] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:02.878879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:02.898243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:03.051021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e2649-fe1f-44d0-ab3d-5073f833468e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:03.053530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:03.078128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1d7ab-8317-498f-b17f-e2436a0d3910 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:03.112354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:03.113456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:03.113927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:03.114393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:03.115615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:03.116131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:03.118934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:03.136840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 463/952] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:03.162302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:03.163471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:03.163956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:03.164431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:03.165841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:03.166355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:03.169071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:03.193260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 490/953] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:03.204410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:03.320626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:03.357595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b935-b0f8-4a06-b45c-c24498fadc91 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:03.398069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:03.398907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:03.399582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:03.399866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:03.409950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:03.415532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:57:03.432705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:03.434386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:57:03.435342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:03.435899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 464/954] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:57:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:03.443024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:03.604018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0d69-c085-4fe4-8df3-02253b8c709b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:03.644968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:03.646060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:03.646540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:03.647034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:03.648112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:03.648623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:03.650409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:03.674428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 491/955] 10.222.0.71 () {56 vars in 1149 bytes} [Wed May 18 13:57:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:03.680522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:03.799948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fa69c-5557-4c8a-9a43-40e4a2d205ac None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:03.841269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:03.848260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:03.849213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:03.849674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:03.849990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:03.871192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:03.873732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:03.902854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:03.903809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:03.904717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:03.904717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:03.904717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:03.904717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:03.905876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 465/956] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:03.911262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:03.922812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:04.066315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fd27a-52a5-49c8-bf41-9e1eb860711a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:04.108349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:04.109078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.109361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.109725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.110530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:04.110837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:04.112269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4623f0-71f5-4502-8a03-7919424ccab1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:04.127962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 492/957] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:04.137402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:04.219332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c089c7-73a6-478e-a1d1-803c8dafccea None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.219944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c089c7-73a6-478e-a1d1-803c8dafccea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.220379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c089c7-73a6-478e-a1d1-803c8dafccea None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.222344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 493/958] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:04.228681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.229332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.230806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.253971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:04.255763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:04.344812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:04.345571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 494/959] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:04.363681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a39735-d0d8-4237-b387-896a2994fb2f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:04.364569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:04.430280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:04.431592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.432086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.432584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.453883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:04.456989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:57:04.486417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:04.488165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:04.489882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:04.493127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 466/960] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:04.499715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:04.571025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5e7c-806e-4a86-aa39-090197bc558e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:04.587620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:04.645501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:04.647447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.648346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.649333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.651232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:04.655335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:04.658660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING keystone.server.flask.common [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 13:57:04.693024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf337bd-118e-4c16-8c75-700748402f1f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:04.713720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.sql.core [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 13:57:04.713720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 13:57:04.713720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [parameters: {'user_id': '744f55b67be74dea887b7b6a0c48deb9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 13:57:04.713720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80331) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application result = self._query(query) May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application conn.query(q) May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application result.read() May 18 13:57:04.747701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 13:57:04.749884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application next(self.gen) May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application yield resource May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application next(self.gen) May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.session.rollback() May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.force_reraise() May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise self.value May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application session.commit() May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 13:57:04.764285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._prepare_impl() May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.session.flush() May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._flush(objects) May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application compat.raise_( May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application flush_context.execute() May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rec.execute(self) May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 13:57:04.765303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application result = connection._execute_20( May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 13:57:04.766476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application result = self._query(query) May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application conn.query(q) May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application result.read() May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 13:57:04.767798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [parameters: {'user_id': '744f55b67be74dea887b7b6a0c48deb9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:04.768897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 18 13:57:04.769742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:04.770777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 495/961] 10.222.0.71 () {60 vars in 1131 bytes} [Wed May 18 13:57:04 2022] POST /identity/v3/users => generated 160 bytes in 389 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:04.771214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:04.771214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.771214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.771214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.771493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:04.771493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:04.771656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:04.771767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:04.799714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 467/962] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:04.809242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:04.849745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:04.908478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c55b1-36e2-4fe5-9fc4-66bb382d675e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:04.953106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:04.954504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:04.955008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:04.955477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:04.965190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:04.967304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:57:04.984736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:04.985793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 13:57:04.986754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:04.994536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 496/963] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:57:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:04.996665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:05.020699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cab73-4239-47c8-81f9-fa2839d13402 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:05.025611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:05.084808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05741341-4376-447f-85c2-9e0939507b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:05.085839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741341-4376-447f-85c2-9e0939507b2a None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:05.086199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741341-4376-447f-85c2-9e0939507b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:05.086551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741341-4376-447f-85c2-9e0939507b2a None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/7881b24eb9e740bb8c74d3e1b2be9428/roles/d64cb70e7b5f4c6482648ed37df3ef1c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:05.089220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05741341-4376-447f-85c2-9e0939507b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=7881b24eb9e740bb8c74d3e1b2be9428, role_id=d64cb70e7b5f4c6482648ed37df3ef1c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:05.091102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05741341-4376-447f-85c2-9e0939507b2a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:05.121070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348134f7-4b82-490e-9a94-414ca1f72415 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:05.143569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:05.162093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:05.162769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:05.163050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:05.163320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:05.164123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:05.164423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:05.166144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fa24-7c52-4a3c-8c5f-6cc677d4819d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:05.197495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 468/964] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:57:04 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/7881b24eb9e740bb8c74d3e1b2be9428/roles/d64cb70e7b5f4c6482648ed37df3ef1c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:57:05.213156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 497/965] 10.222.0.71 () {56 vars in 1101 bytes} [Wed May 18 13:57:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:05.700563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073435-ea1e-47a0-8ca0-0c1167acff92 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:05.700904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073435-ea1e-47a0-8ca0-0c1167acff92 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:05.701273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073435-ea1e-47a0-8ca0-0c1167acff92 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:05.702867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 469/966] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:05.708624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:05.709414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:05.709414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:05.737784 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:05.740629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:05.829984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1142a-fb59-4ace-a81b-7002ab7353e6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:05.830248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1142a-fb59-4ace-a81b-7002ab7353e6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:05.830619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1142a-fb59-4ace-a81b-7002ab7353e6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:05.832222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 470/967] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:05.837567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:05.837928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:05.838436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:05.838544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 498/968] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:05.862708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:05.868189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:05.870851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:05.973995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566a3a7-d5fe-4b6a-a53b-047392149836 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:05.982271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:05.994942 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 471/969] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:06.021448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:06.026152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:06.027549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:06.028038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:06.028526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:06.029794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:06.032428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:06.059579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:06.060983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:06.062036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 499/970] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:57:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:06.067817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:06.174366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:06.184775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2efb4b-74d9-463b-963c-72a3442b5e33 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:06.196812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f70daf-2959-4c5b-99c5-e7c6e46535a0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:06.245158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:06.248082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:06.248082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:06.248082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:06.248082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:06.248364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:06.248589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:06.249615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:06.249786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:06.250319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:06.250818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:06.252199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:06.254846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:06.256158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 500/971] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:57:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:06.261944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:06.350667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 472/972] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:57:06 2022] POST /identity/v3/services => generated 242 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:57:06.393694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:06.530229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe5324-00cb-4d96-9a42-e59694a7b18c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:06.602744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:06.603894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:06.604457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:06.606274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:06.607675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:06.608248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:06.610927 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:06.619353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 501/973] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:57:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:06.629149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:06.765429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4a36b-a60a-4762-ace1-b063cc49ac53 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:06.807019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:06.807588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:06.808115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:06.808604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:06.809571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] RBAC: Adding query filter params (interface=admin, service_id=14e7b6b802084ffbbd8921e1affdef7e, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:06.809878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:06.811289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a74ac0-7204-4aab-acee-48380cdbc54f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:06.824845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 473/974] 10.222.0.71 () {56 vars in 1249 bytes} [Wed May 18 13:57:06 2022] GET /identity/v3/endpoints?service_id=14e7b6b802084ffbbd8921e1affdef7e&interface=admin®ion_id=RegionOne => generated 193 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:06.826974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:06.961678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:06.975277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267a1a0-7aef-407d-8793-f5f0e0e2249d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:07.039477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ce212-3646-47f1-9acb-565b421dab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:07.040636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ce212-3646-47f1-9acb-565b421dab67 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:07.041171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ce212-3646-47f1-9acb-565b421dab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:07.041649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ce212-3646-47f1-9acb-565b421dab67 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:07.043675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ce212-3646-47f1-9acb-565b421dab67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:07.046271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ce212-3646-47f1-9acb-565b421dab67 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:07.065425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 502/975] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:57:06 2022] GET /identity/v3/services => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 13:57:07.864609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499de1e-b376-4a09-b099-dd5cc3e86e48 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:07.865191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499de1e-b376-4a09-b099-dd5cc3e86e48 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:07.865191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499de1e-b376-4a09-b099-dd5cc3e86e48 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:07.866584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 474/976] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:07.872719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:07.873575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:07.873575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:07.891871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:07.893134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:07.973512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 503/977] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:07.998340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499de1e-b376-4a09-b099-dd5cc3e86e48 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:08.019132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:08.128679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499de1e-b376-4a09-b099-dd5cc3e86e48 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:08.174074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:08.174910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:08.175192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:08.175440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:08.188928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:08.197588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:08.199496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:08.206546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 475/978] 10.222.0.71 () {56 vars in 1120 bytes} [Wed May 18 13:57:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:08.213343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:08.363742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:08.377913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752fadb-1bf6-4181-bfbd-b08d0cc4911b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:08.419674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:08.420351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:08.420633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:08.420947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:08.421716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:08.422027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:08.423427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:08.434389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 504/979] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:57:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:08.439906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:08.534112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:08.559382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3b74-803a-44c3-83d8-04877c9c9f22 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:08.599970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:08.600778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:08.601088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:08.601365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:08.615695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:08.617380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d30e41a8-f5fe-4a4f-afe6-b2f2ff0e14e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:08.637719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:08.639428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:08.642160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:08.642160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:08.642160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:08.642160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:08.644833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 476/980] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:08.646252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:08.848277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6a5c1-8d1b-4e79-b187-d6305121129a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:08.855088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f01a7-92aa-4b66-aa4b-90a2ddd9723d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:08.856146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f01a7-92aa-4b66-aa4b-90a2ddd9723d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:08.856146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f01a7-92aa-4b66-aa4b-90a2ddd9723d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:08.857431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 477/981] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:08.863036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:08.863303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:08.863616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:08.881480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:08.882681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:08.913405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:08.914159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:08.914350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:08.914625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:08.915453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:08.915756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:08.917935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:08.939389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 505/982] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:08.940957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:08.962491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:09.003598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 478/983] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:09.025742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:09.101895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5f4e7-75c0-4ba6-be17-f0fc6d5a22cd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.156085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.157339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:09.157548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.158028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.158534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.173856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.176660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:57:09.197755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:09.200655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:09.201823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 506/984] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:57:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:09.209975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:09.227196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a642ce-df2a-4cdd-9283-70ee5458610b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.305506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.306676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.307118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.308173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.309019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.310739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:09.324683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:09.326680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:09.328467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 479/985] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:09.334969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:09.340595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:09.404640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7dbb0-9d24-448f-aad8-5d9a46fd5376 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.467819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.468715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.469167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.469566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.470786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:09.471378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.473487 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.505932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 507/986] 10.222.0.71 () {56 vars in 1149 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:09.507860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:09.509249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e7be-b3c7-425f-8b20-2994bb394748 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.552965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:09.565978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.577329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.577329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.577329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.577329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:09.577329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.577329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.581264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 480/987] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:09.584035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:09.677620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae95c4-f726-42eb-a265-dbcc3fee8c1e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.709555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:09.719070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.720271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.720677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.721151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.736812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2025e1d-9efc-4c79-ba5d-3ffef955feee None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.779550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.780501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.780869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.781154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.781874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:09.782177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.783604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459c7a-cc53-4452-a290-0f9084df881f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.789142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 481/988] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:09.790507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d4d3-bc92-4d3e-9cbe-10574798b133 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.790792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d4d3-bc92-4d3e-9cbe-10574798b133 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.791065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740d4d3-bc92-4d3e-9cbe-10574798b133 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.792982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 482/989] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:09.797126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740d4d3-bc92-4d3e-9cbe-10574798b133 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:09.829111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.831826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.858293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:09.934553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740d4d3-bc92-4d3e-9cbe-10574798b133 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:09.972263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:09.973204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.973599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.973965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.974871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] RBAC: Adding query filter params (interface=public, service_id=6f27d33f8de046d6ab4bd5e2d747ef69, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:09.975317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:09.976969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfcacfa-4b06-447e-89db-d208dd9529f2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:09.983798 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 483/990] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/endpoints?service_id=6f27d33f8de046d6ab4bd5e2d747ef69&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:09.985406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:09.985832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:09.986235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:09.999873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 508/991] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:57:10.001139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.005926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:10.006722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:10.035348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:10.102359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 484/992] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:10.103816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.143719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d52711-b0b5-45a0-b442-13981481be36 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.181916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:10.196019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:10.196019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:10.196019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:10.196019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:10.196687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:10.197921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:10.212855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 509/993] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:57:09 2022] GET /identity/v3/services => generated 1727 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 13:57:10.212855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.288395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac528c-b84b-4e9c-9bbc-ee0fc41bda63 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.352295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:10.353834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:10.354733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:10.355146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:10.373113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:10.376724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:10.379593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:10.393292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cefe7a-2c94-4c14-896a-9ce865ec1065 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:10.418309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:10.419531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:10.420643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:10.420643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:10.420643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:10.420643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:10.421139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 485/994] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:10.430583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.472626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:10.474107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:10.474580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:10.475063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:10.476281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:10.478616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:10.502722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:10.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 13:57:10.504808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:10.505588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 510/995] 10.222.0.71 () {56 vars in 1126 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:10.512621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.607926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:10.614571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de51705-b17f-4ae2-bd82-8389250078a9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.683035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:10.683379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2e3f6-cf59-41a8-8be4-22daa2f37753 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.684060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:10.684526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:10.685031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:10.686441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:10.686999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:10.689537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:10.710651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 486/996] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:10.712220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.751984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:10.752937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:10.753368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:10.753811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:10.754989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:10.755497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:10.757894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:10.767391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 511/997] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:10.777622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:10.804956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:10.887912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d94fc-3175-4caf-86b8-5e4e7ea1422e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.946711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:10.948217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:10.948690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:10.949212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:10.953644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175d607-cc49-457b-b015-b8a4b9b037d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:10.960142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:10.961653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:57:10.977805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:10.986104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:10.988060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 487/998] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:10.993012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:11.018081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:11.018877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:11.019020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:11.019158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:11.019886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:11.020195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:11.021696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:11.029195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 512/999] 10.222.0.71 () {56 vars in 1122 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:11.034894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:11.038221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:11.157073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4dd64-f8f9-4916-8e78-e8e15ac18f21 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:11.165972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:11.195558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:11.196230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:11.196533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:11.196767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:11.196988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648235a-b26d-4711-95c9-d4b7efdfc6e7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:11.197700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:11.198040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:11.199515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:11.212693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 488/1000] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:11.219363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:11.259151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b19f7-6e53-4af6-8b3f-5943f0a09f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:11.259828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b19f7-6e53-4af6-8b3f-5943f0a09f63 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:11.260102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b19f7-6e53-4af6-8b3f-5943f0a09f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:11.260378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b19f7-6e53-4af6-8b3f-5943f0a09f63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:11.262210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b19f7-6e53-4af6-8b3f-5943f0a09f63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:11.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b19f7-6e53-4af6-8b3f-5943f0a09f63 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:11.321868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:11.322061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 513/1001] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:57:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:57:11.351552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeeeab-a685-4c0b-b021-7ec66363b9a2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:11.402186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:11.402943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:11.403232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:11.403513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:11.404554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] RBAC: Adding query filter params (role.id=d64cb70e7b5f4c6482648ed37df3ef1c, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=7881b24eb9e740bb8c74d3e1b2be9428) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:11.404910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:11.406443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef0ab-2728-4a39-84d0-1df49a07f110 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:11.420811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 489/1002] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:11 2022] GET /identity/v3/role_assignments?user.id=7881b24eb9e740bb8c74d3e1b2be9428&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=d64cb70e7b5f4c6482648ed37df3ef1c => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:12.832849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f48c4-b996-4beb-9bdf-3b9afda9e581 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:12.833631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f48c4-b996-4beb-9bdf-3b9afda9e581 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:12.833631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f48c4-b996-4beb-9bdf-3b9afda9e581 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:12.834860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 514/1003] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:12.841591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:12.842338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:12.842338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:12.861894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:12.863385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:12.944240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 490/1004] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:12.968039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f48c4-b996-4beb-9bdf-3b9afda9e581 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:13.162048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f48c4-b996-4beb-9bdf-3b9afda9e581 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:13.229543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:13.229756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:13.230314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:13.233115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:13.233115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:13.235525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:13.258213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:13.261280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:13.263607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 515/1005] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:13.270306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:13.395303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:13.458950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce4bf-046d-4bf5-aef1-020f4b41b36c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:13.522725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:13.523864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:13.524372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:13.524905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:13.526107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:13.526612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:13.528744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:13.538567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 491/1006] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:13.548142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:13.569114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:13.744345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525341ef-2ec9-46c8-823e-71e048814220 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:13.810554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:13.811751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:13.812243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:13.812719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:13.814060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:13.814589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:13.817195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38482c7b-ed66-485a-9466-89bc2370dc16 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:13.833205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 516/1007] 10.222.0.71 () {56 vars in 1112 bytes} [Wed May 18 13:57:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:13.837831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:14.034769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a2d7e-9ab2-42ea-95dd-6f127ddd4ce9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:14.092199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:14.101459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4fd2b-eacd-4c81-aeae-3e47d4dbb7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:14.102710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4fd2b-eacd-4c81-aeae-3e47d4dbb7eb None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.103333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4fd2b-eacd-4c81-aeae-3e47d4dbb7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.103706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4fd2b-eacd-4c81-aeae-3e47d4dbb7eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.105734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4fd2b-eacd-4c81-aeae-3e47d4dbb7eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:14.108323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4fd2b-eacd-4c81-aeae-3e47d4dbb7eb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:14.231833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 492/1008] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:57:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:14.384583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad82f4-8144-4dab-a9ce-ff6a700f8a03 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.385164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad82f4-8144-4dab-a9ce-ff6a700f8a03 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.385703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad82f4-8144-4dab-a9ce-ff6a700f8a03 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.388532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 517/1009] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:14.395177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.395464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.395799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.414636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:14.415895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:14.484544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67b25f-0a64-4389-9558-5e053d04ba83 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.485040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67b25f-0a64-4389-9558-5e053d04ba83 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.485193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67b25f-0a64-4389-9558-5e053d04ba83 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.487289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 518/1010] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:14.492133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.492501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.492689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.511634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:14.514005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:14.521034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 493/1011] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:14.546329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:14.626622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 519/1012] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:14.665806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:14.669574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:14.698883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d790-21b2-4a66-a3a9-cd3272384596 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:14.717985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:14.747300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:14.748993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.748993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.749588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.752287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:14.755925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:14.767103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 494/1013] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:14.768960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:14.817564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238efdd5-3f77-40d9-9816-30f86d14357b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:14.858000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:14.858805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.859091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.859361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] PATH_INFO: `/v3/services/image` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.860018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:14.861442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:14.878346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:14.880157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:14.881329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 520/1014] 10.222.0.71 () {56 vars in 1105 bytes} [Wed May 18 13:57:14 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:14.885741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:14.912047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61479d-8c02-4dc0-b54e-e597cf5977aa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:14.960828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c467c01-d320-421b-ab2b-91ac393d9bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:14.961514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c467c01-d320-421b-ab2b-91ac393d9bb9 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:14.961989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c467c01-d320-421b-ab2b-91ac393d9bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:14.962275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c467c01-d320-421b-ab2b-91ac393d9bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:14.963005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c467c01-d320-421b-ab2b-91ac393d9bb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:14.965326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c467c01-d320-421b-ab2b-91ac393d9bb9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:14.988271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:15.044171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51341-cd56-401d-b4be-02e85174949f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:15.085808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:15.086512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:15.086798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:15.087074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:15.087795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:15.088099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:15.090816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:15.096579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 521/1015] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:15.103430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:15.119849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 495/1016] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:57:14 2022] POST /identity/v3/projects => generated 311 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:15.258946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307046d6-349d-4d41-8751-1344b1aa74d2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:15.297104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:15.304158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:15.304892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:15.305167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:15.305445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:15.306295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] RBAC: Adding query filter params (type=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:15.306656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:15.308070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283234aa-b7c4-4804-a069-303fb38ba20a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:15.314402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 522/1017] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:16.878235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c226ee-1c25-442a-8e62-8fd4b8729355 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:16.879096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c226ee-1c25-442a-8e62-8fd4b8729355 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:16.879096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c226ee-1c25-442a-8e62-8fd4b8729355 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:16.880429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 496/1018] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:16.887730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:16.888257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:16.888864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:16.911535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:16.912747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:16.996829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 523/1019] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:16 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:17.020836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c226ee-1c25-442a-8e62-8fd4b8729355 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.064303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:17.159778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c226ee-1c25-442a-8e62-8fd4b8729355 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:17.220326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:17.221772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.222274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.222766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.242655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:17.251924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:17.255918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:17.258403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 497/1020] 10.222.0.71 () {56 vars in 1120 bytes} [Wed May 18 13:57:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:17.263425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.449663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cfbc2-38bd-45ef-951c-afc22b6820ae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:17.478423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:17.492460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:17.493986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.493986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.493986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.494437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:17.495022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:17.496418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9dd3ad-dd7d-4253-b87c-25fb703064fd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:17.506208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 524/1021] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:57:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:17.513076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.581834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418eef-7923-4ef8-b3f8-348cea79b452 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.582124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418eef-7923-4ef8-b3f8-348cea79b452 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.582446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418eef-7923-4ef8-b3f8-348cea79b452 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.583987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 525/1022] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:17.590608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.590998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.591151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.611626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:17.614125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:17.650036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:17.657442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af78b1-7c61-43d4-9e39-2cbcde14e3e4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:17.694342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:17.695144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.695420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.695695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.707530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:17.708952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:17.720288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 526/1023] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:17.727773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:17.737227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:17.739037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:17.739037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:17.739037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:17.739037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:17.739037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 498/1024] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:17.742034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.755271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.861355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8d064-3046-447d-8c26-bcc759a5b7fb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:17.891370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:17.897005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9238-7756-422e-82bb-ba607cdca10b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:17.919461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:17.920366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.920863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.921315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.922242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:17.922750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:17.924999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:17.952830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 527/1025] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:17.956556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.959952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:17.961043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:17.961491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:17.961999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:17.964915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:17.966462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:17.968564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 499/1026] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:17.974363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:17.992548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:18.104729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08101b0c-b5aa-47f2-8ce9-49736cf84d53 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:18.143657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ca9e-96bf-4225-82be-13427a6a048c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:18.154794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5754-97b8-4a2a-a326-419473c155be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:18.155771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5754-97b8-4a2a-a326-419473c155be None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.156279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5754-97b8-4a2a-a326-419473c155be None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.156772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5754-97b8-4a2a-a326-419473c155be None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.158159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5754-97b8-4a2a-a326-419473c155be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:18.161019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5754-97b8-4a2a-a326-419473c155be None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:18.182303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:18.186155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.186155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.186155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.192919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:18.194389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:57:18.210449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:18.212642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:18.215276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 528/1027] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:57:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:18.218478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:18.264913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:18.293119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 500/1028] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:57:17 2022] POST /identity/v3/users => generated 285 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:57:18.394136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf51bc-2ec2-46bd-8084-dc8503473c66 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:18.465959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:18.467027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.467488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.467774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.469227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:18.469776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:18.472516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0dad27-ec99-4dde-b2c9-01eddeb94e01 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:18.507659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767bf2-b586-4079-bdaa-8371ff16aff0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.508186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767bf2-b586-4079-bdaa-8371ff16aff0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.508551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 529/1029] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:57:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:18.509077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27767bf2-b586-4079-bdaa-8371ff16aff0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.511603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 501/1030] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:18.518406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27767bf2-b586-4079-bdaa-8371ff16aff0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:18.519579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.520095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.520572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.554681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:18.556830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:18.633738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:18.667416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 530/1031] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:18.699151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27767bf2-b586-4079-bdaa-8371ff16aff0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:18.703275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:18.742626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:18.770407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:18.771583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.772086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.772590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.879178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750051a-e937-45b5-8ff1-f03a8ccc835d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:18.926094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:18.929684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:18.935314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:18.936500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:18.938893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:18.938893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:18.939196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:18.941715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:19.060951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 531/1032] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:57:18 2022] POST /identity/v3/services => generated 242 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:19.061215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:19.131388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 502/1033] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:18 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:57:19.133650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:19.318946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:19.357989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1f0c7-e28c-411e-96f7-625d4ef34ee2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:19.401955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:19.402762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:19.403042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:19.403322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:19.415895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:19.417504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:19.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:19.439249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:19.441467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:19.441467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:19.441467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:19.441467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:19.441467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 532/1034] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:19.444911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:19.584431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c259189-79cb-42b2-87ca-74926ba58563 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:19.628432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:19.629318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:19.629726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:19.630138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:19.631004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:19.631440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:19.633014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:19.652149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 503/1035] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:19.656696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:19.800041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb699b1-5682-4a30-a243-9fa695e3d201 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:19.837221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:19.845827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:19.852495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:19.852495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:19.852495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:19.861310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:19.863299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:57:19.886433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:19.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:19.896638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 533/1036] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:19.897244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:19.939650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:20.092251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41533-7033-45d3-ac87-fd7f3e8307a7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:20.168164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:20.169422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:20.169913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:20.170407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:20.171954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:20.172511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:20.175691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7dabc-eaa7-4d0d-989d-92447e6ecf49 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:20.216836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 504/1037] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:20.221410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:20.403218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae03e22-0479-47ee-86de-5517ac20b340 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:20.482555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:20.489718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:20.489718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:20.489718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:20.489718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] RBAC: Adding query filter params (role.id=d64cb70e7b5f4c6482648ed37df3ef1c, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=bd1a4928c641445e8b78a2836c680536) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:20.489718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:20.490511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcabda-de83-4104-9ba5-399a1bd925dc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:20.508847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 534/1038] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:20 2022] GET /identity/v3/role_assignments?user.id=bd1a4928c641445e8b78a2836c680536&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=d64cb70e7b5f4c6482648ed37df3ef1c => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:20.831528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0691e6-cb8e-420c-b2f3-b63863e5476f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:20.831793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0691e6-cb8e-420c-b2f3-b63863e5476f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:20.831957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0691e6-cb8e-420c-b2f3-b63863e5476f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:20.833698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 505/1039] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:20.840441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:20.841007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:20.841376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:20.862471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:20.863687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:20.944418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:20.984880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 535/1040] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:21.037527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0691e6-cb8e-420c-b2f3-b63863e5476f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:21.285447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:21.308112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0691e6-cb8e-420c-b2f3-b63863e5476f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:21.379994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:21.381421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:21.381915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:21.382395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:21.404929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:21.420353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:21.422159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:21.423749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:21.429314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 506/1041] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:21.433936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:21.623109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85056116-32dc-47aa-aeef-04da2baad325 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:21.687372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:21.688512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:21.689021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:21.689511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:21.690940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:21.691463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:21.694051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:21.711053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 536/1042] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:21.720471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:21.891213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c10ae9-cb3f-4e1e-9025-9ae0df104e20 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:21.931518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60885eb-fc05-4934-adbf-89997960e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:21.933009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60885eb-fc05-4934-adbf-89997960e567 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:21.933291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60885eb-fc05-4934-adbf-89997960e567 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:21.933685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60885eb-fc05-4934-adbf-89997960e567 None admin] PATH_INFO: `/v3/users/e2df736c617f4c2cbccee0da21299979` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:21.950056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60885eb-fc05-4934-adbf-89997960e567 None admin] RBAC: Authorizing `identity:get_user(user_id=e2df736c617f4c2cbccee0da21299979)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:21.951525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60885eb-fc05-4934-adbf-89997960e567 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:21.953366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 507/1043] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:21 2022] GET /identity/v3/users/e2df736c617f4c2cbccee0da21299979 => generated 285 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:21.960056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:22.056126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:22.131304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5f7b-86cb-451c-9b87-2f81a4a0a2d1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:22.131868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5f7b-86cb-451c-9b87-2f81a4a0a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:22.132178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd5f7b-86cb-451c-9b87-2f81a4a0a2d1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:22.134498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 508/1044] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:22.143505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:22.143848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:22.144210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:22.149867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36025e-c484-43c8-862f-afe13a685520 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:22.171480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:22.173427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:22.176683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:22.209558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:22.210547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:22.210991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:22.211433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:22.298452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 509/1045] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:22.335736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:22.349133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:22.351666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:22.438376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:22.513384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 537/1046] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 13:57:22.517266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca152c-d7d9-4502-8d1c-7910786a895d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:22.519530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:22.578949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:22.580224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:22.580677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:22.581195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:22.582112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:22.584574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:22.605332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:22.607451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:22.610251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 510/1047] 10.222.0.71 () {56 vars in 1105 bytes} [Wed May 18 13:57:22 2022] GET /identity/v3/services/image => generated 86 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:22.614847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:22.619073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:22.716017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726ac5d-3f7d-40f4-938c-69c1a173ac67 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:22.771896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:22.772809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:22.773117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:22.773393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:22.774857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] RBAC: Authorizing `identity:get_project(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:22.777247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:22.779358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 538/1048] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:22 2022] GET /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71 => generated 311 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:22.785403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:22.786660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae2a3f-fd5e-4a96-82c3-df409d4e1bf4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:22.807673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:22.831376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:22.832056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:22.832334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:22.832605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:22.833365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] RBAC: Adding query filter params (name=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:22.833665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:22.835098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:22.842318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 511/1049] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:22.848078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:22.939070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:22.951062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b6ce-0095-4613-b498-18a6236d1586 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:22.986829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9349a-b266-4368-836f-e3351a339650 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:23.021781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.022807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.023259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.023657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.024907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71, user.id=e2df736c617f4c2cbccee0da21299979) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:23.025249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:23.027296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:23.043910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 539/1050] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:22 2022] GET /identity/v3/role_assignments?user.id=e2df736c617f4c2cbccee0da21299979&scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:23.044183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.044183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.044183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.044183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.044825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] RBAC: Adding query filter params (type=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:23.044825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:23.044825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d37a5c-8b9d-4cda-b1d2-7f2f2f29442e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:23.057494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 512/1051] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:23.063746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:23.152216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773b699-4624-4439-96f0-1c394d70631f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.152758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773b699-4624-4439-96f0-1c394d70631f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.152758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773b699-4624-4439-96f0-1c394d70631f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.154400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 513/1052] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:23.160002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.160330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.160566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.174240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:23.180054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:23.181355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:23.214543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65217a1e-3bb9-405f-a3f0-609f3c49a367 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:23.272668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 514/1053] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:23.284103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.285196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.285690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.286137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.287148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] RBAC: Adding query filter params (interface=public, service_id=329c0ebfbf7d456f9a7ffa4efef5e795, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:23.287645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:23.289308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:23.296108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:23.297574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 540/1054] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 13:57:23 2022] GET /identity/v3/endpoints?service_id=329c0ebfbf7d456f9a7ffa4efef5e795&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:23.310308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:23.363928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:23.419143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ac640-12fb-47e5-9f53-f3322d85ebb6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:23.470354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.471182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.471468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.471744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.484703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:23.491861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346b397-8004-45a0-9e0a-34a077a2fc23 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:23.493213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:23.495612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:23.497414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:23.500184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 515/1055] 10.222.0.71 () {56 vars in 1120 bytes} [Wed May 18 13:57:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:23.501191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:23.564345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.565355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.565793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.566216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.567044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:23.568769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:23.588823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 541/1056] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 13:57:23 2022] GET /identity/v3/services => generated 1957 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 13:57:23.659737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c662-8dab-47c7-9107-fc935039c79a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:23.686357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:23.705436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.706313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.706739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.707150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.708142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:23.708635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:23.710227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:23.727477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 516/1057] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:57:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:23.729756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:23.744941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:23.900389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8041768-4f04-456d-a70a-0b44c82524c2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:23.965418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:23.966827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:23.967231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:23.967724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:23.987623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:23.990376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:24.026358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:24.028124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:24.030837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:24.030837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:24.030837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:24.030837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:24.030837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 542/1058] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:24.036876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:24.171453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971d13-4435-4800-bbfb-1931cde5367c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:24.218314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:24.219350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:24.219815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:24.220309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:24.221340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:24.221818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:24.223446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:24.252390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 517/1059] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:24.253954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:24.339825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:24.390792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ce7e0-ec41-4c6e-84e6-007e93970679 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:24.430689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:24.431483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:24.432306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:24.432568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:24.441606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:24.443067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:57:24.459358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:24.461767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:24.464019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 543/1060] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:57:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:24.466899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:24.518085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:24.581886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993dbdc-e08f-4ccd-bf99-f97b7f37e837 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:24.617399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:24.617998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:24.618275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:24.618548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:24.619959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:24.620482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:24.622118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:24.648231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 518/1061] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:57:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:24.655032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:24.795162 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6343e8-04b1-4bc3-9a2f-bcaa77079bcd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:24.819873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:24.836289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:24.839223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:24.839223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:24.839223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:24.851144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:24.852625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:24.873132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:24.874771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:24.876483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:24.876483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:24.876483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:24.876483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:24.876483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 544/1062] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:24.883577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:25.069515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:25.076593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef94e5d-ffaf-4554-bd92-2e5d28bef852 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:25.147714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:25.148758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:25.149298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:25.149791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:25.152133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:25.152649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:25.155326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:25.184826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 519/1063] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:25.190247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:25.401051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc909d8-7256-48f0-9cfe-422c8e3f63e9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:25.465535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:25.466912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:25.467409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:25.467901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:25.482448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:25.485344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5bd3618b-2bc5-44ed-bca5-397367bbee75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:57:25.515082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:25.517567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:25.527253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 545/1064] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:25.529522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:25.663249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c735f-8d12-43b2-b175-9b9b9ad6e0bb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:25.664745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c735f-8d12-43b2-b175-9b9b9ad6e0bb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:25.665584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c735f-8d12-43b2-b175-9b9b9ad6e0bb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:25.669178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 546/1065] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:25.678374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:25.678876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:25.679375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:25.710076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:25.711842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:25.720251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73beb9f4-7f89-41e1-8489-f6af6eea995a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:25.763942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:25.770181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:25.770886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:25.771144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:25.771388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:25.772474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:25.772640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:25.774020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:25.792859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 520/1066] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:25.799059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:25.828226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:25.856169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 547/1067] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:25.894010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:25.928297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59041fca-abc5-4990-83e4-2447147924c5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:25.968732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:25.970231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:25.970533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:25.970799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/bd1a4928c641445e8b78a2836c680536/roles/d64cb70e7b5f4c6482648ed37df3ef1c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:25.973496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=bd1a4928c641445e8b78a2836c680536, role_id=d64cb70e7b5f4c6482648ed37df3ef1c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:25.976196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:26.036552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dac30-9bd0-4470-aed1-66cccccbff8b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:26.064025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 521/1068] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:57:25 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/bd1a4928c641445e8b78a2836c680536/roles/d64cb70e7b5f4c6482648ed37df3ef1c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:57:26.090553 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87663a-b343-423c-8503-9b509497336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:26.091392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87663a-b343-423c-8503-9b509497336c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.091715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87663a-b343-423c-8503-9b509497336c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.091995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87663a-b343-423c-8503-9b509497336c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.107601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87663a-b343-423c-8503-9b509497336c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5f87663a-b343-423c-8503-9b509497336c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:26.115974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:26.118139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:26.119955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 548/1069] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:57:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:26.124841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:26.269154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:26.295384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e327c0-4eb8-410d-95b4-f8a0225101a6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:26.321925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674cf7d-5248-4a8a-a65d-054622e17b5a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.323596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674cf7d-5248-4a8a-a65d-054622e17b5a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.323911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674cf7d-5248-4a8a-a65d-054622e17b5a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.325788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 549/1070] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:26.332506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.333178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.333753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.345738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:26.346827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.347297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.347737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.349177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:26.349702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:26.352114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:26.369477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:26.370381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 522/1071] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:57:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:26.371311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:26.379779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:26.400402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:26.495942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 550/1072] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:26.539641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:26.545715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f219c-f7fa-4f48-ab81-30a1b7fcfd1a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:26.587688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:26.589640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.589909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.590185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] PATH_INFO: `/v3/users/e2df736c617f4c2cbccee0da21299979` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.591513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] RBAC: Authorizing `identity:get_user(user_id=e2df736c617f4c2cbccee0da21299979)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:26.593063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:26.602321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 523/1073] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:26 2022] GET /identity/v3/users/e2df736c617f4c2cbccee0da21299979 => generated 285 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:26.603760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:26.627606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:26.728740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b966401-b14a-47d0-8c5c-ce9a67d5ef88 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:26.759011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d55567-4de6-40dd-a195-e5ae34f9f060 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:26.789049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:26.789974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.790175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.790436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] PATH_INFO: `/v3/services/image` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.791190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:26.792750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:26.807722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:26.809757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:26.812829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 551/1074] 10.222.0.71 () {56 vars in 1105 bytes} [Wed May 18 13:57:26 2022] GET /identity/v3/services/image => generated 86 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:26.816723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:26.817267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:26.817517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:26.817793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:26.819179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] RBAC: Authorizing `identity:get_project(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:26.820287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:26.820677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:26.831696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 524/1075] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:26 2022] GET /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71 => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:26.833788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:26.859713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:26.970422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:26.983336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfa23c-dc05-44e8-9e72-244cfc5ee10e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:26.997881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fddf-a676-481e-9315-94274a8fb40d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:27.034781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:27.035459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:27.035740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:27.036013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:27.036731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:27.037154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:27.038467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:27.044746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 552/1076] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:27.052212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:27.054221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:27.055384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:27.055855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:27.056400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71/users/e2df736c617f4c2cbccee0da21299979/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:27.059290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71, user_id=e2df736c617f4c2cbccee0da21299979, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:27.061043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:27.146867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 525/1077] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:57:26 2022] PUT /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71/users/e2df736c617f4c2cbccee0da21299979/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 13:57:27.167801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:27.196080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb053-5996-44c5-b2d0-4af2c3f82c61 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:27.258361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:27.259140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:27.259433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:27.259845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:27.261325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:27.261704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:27.263148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97291a63-d485-4ecd-a6b6-0dbd84fa3c89 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:27.276473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 553/1078] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:27.279045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:27.419929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e35879-075c-4295-bf41-39b41c4356b2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:27.486311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12919dba-fc12-405c-9536-1c0e654a0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:27.487934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919dba-fc12-405c-9536-1c0e654a0eba None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:27.488715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919dba-fc12-405c-9536-1c0e654a0eba None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:27.489441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919dba-fc12-405c-9536-1c0e654a0eba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:27.491052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12919dba-fc12-405c-9536-1c0e654a0eba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:27.493925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12919dba-fc12-405c-9536-1c0e654a0eba None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:27.507350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:27.577604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 526/1079] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 13:57:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:28.589696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd044-e005-47d3-bf9d-3123ee215514 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:28.590215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd044-e005-47d3-bf9d-3123ee215514 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:28.590693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fd044-e005-47d3-bf9d-3123ee215514 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:28.593489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 554/1080] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:28.600693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:28.601251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:28.601701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:28.633661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:28.636200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:28.776878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 527/1081] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:28.800225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd044-e005-47d3-bf9d-3123ee215514 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:28.924270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fd044-e005-47d3-bf9d-3123ee215514 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:28.965762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:28.966675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:28.967112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:28.967295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:28.980437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:28.988978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:28.990858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 13:57:28.993458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:28.996828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 555/1082] 10.222.0.71 () {56 vars in 1120 bytes} [Wed May 18 13:57:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:28.997691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:29.176543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfb84c-7f0a-4e28-8fae-36f111c80aad None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:29.202305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:29.219039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:29.219766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:29.220129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:29.220408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:29.221203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:29.221509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:29.223062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:29.247397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 528/1083] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:57:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:29.249338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:29.255868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:29.436643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cce65f-0579-4ce9-9745-39533a48dfa6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:29.496708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:29.498000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:29.498439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:29.498846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:29.521212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:29.524955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4a748aa0-cd67-498f-a622-624ea987e2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:29.565068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:29.566936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:29.574694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:29.574694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:29.574694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:29.574694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:29.574694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 556/1084] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:29.580979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:29.764534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917de5e-3804-4f5f-915f-3efa59005ec7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:29.765297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917de5e-3804-4f5f-915f-3efa59005ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:29.765297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917de5e-3804-4f5f-915f-3efa59005ec7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:29.766847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 557/1085] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:29.773663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:29.773999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:29.774326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:29.777085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5d6a-04e7-4a45-b898-31904fd6c25e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:29.795298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:29.797222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:29.838671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:29.839566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:29.840021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:29.840467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:29.841740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:29.842253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:29.844554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:29.867218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 529/1086] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:29.878618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:29.898858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:29.928878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 558/1087] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:29.953443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:29.965271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:30.035792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12fc71-cf33-4d9c-8d71-fe7a3f26341b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.081898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:30.082884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.083308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.083710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.094081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:30.096416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:57:30.115043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:30.116917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:30.119841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 530/1088] 10.222.0.71 () {56 vars in 1093 bytes} [Wed May 18 13:57:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:30.125847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:30.166878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020ca06-99d2-43c0-b16e-e255ba58c9a1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.238181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:30.240176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.240176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.240602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.261484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:30.277154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:30.279090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:30.281808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 559/1089] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:57:30.287004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:30.299787 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d390e-06f4-418e-b957-c26d77430fcc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.302842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:30.367767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:30.369088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.369602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.370344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.372042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:30.372615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:30.375523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:30.378115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:30.416688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 531/1090] 10.222.0.71 () {56 vars in 1133 bytes} [Wed May 18 13:57:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:30.418693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:30.483567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730b8ab-b5da-4f17-86a3-0d13da4535e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.546736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ae9c-9c8e-43c4-aad5-f8c729fab459 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.551287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:30.552418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.552953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.553419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.554822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:30.555362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:30.558093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:30.576857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 560/1091] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:30.582410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:30.596340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1f72-305d-42b1-8d28-e87c574ed8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:30.597053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1f72-305d-42b1-8d28-e87c574ed8ae None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.597341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1f72-305d-42b1-8d28-e87c574ed8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.597596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1f72-305d-42b1-8d28-e87c574ed8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.639137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:30.717222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1f72-305d-42b1-8d28-e87c574ed8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:30.720149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1f72-305d-42b1-8d28-e87c574ed8ae None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:30.763378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f42a1-7ef7-4826-9f63-739531221b4e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.775709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:30.803436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33759a3-4a30-48fb-9a73-eb69be8820fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:30.804585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33759a3-4a30-48fb-9a73-eb69be8820fa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.805006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33759a3-4a30-48fb-9a73-eb69be8820fa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.805440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33759a3-4a30-48fb-9a73-eb69be8820fa None admin] PATH_INFO: `/v3/users/e2df736c617f4c2cbccee0da21299979` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.807483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33759a3-4a30-48fb-9a73-eb69be8820fa None admin] RBAC: Authorizing `identity:get_user(user_id=e2df736c617f4c2cbccee0da21299979)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:30.809358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33759a3-4a30-48fb-9a73-eb69be8820fa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:30.811199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 561/1092] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:30 2022] GET /identity/v3/users/e2df736c617f4c2cbccee0da21299979 => generated 285 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:30.813065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541b2d-d411-49a2-bfe2-c7468c14fefb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.813493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541b2d-d411-49a2-bfe2-c7468c14fefb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.814057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541b2d-d411-49a2-bfe2-c7468c14fefb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.815702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 562/1093] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:30.820430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541b2d-d411-49a2-bfe2-c7468c14fefb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:30.878507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 532/1094] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 13:57:30.881507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:30.882002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:30.882488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:30.903506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:30.904850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:30.961607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541b2d-d411-49a2-bfe2-c7468c14fefb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:30.970140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:30.982902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 533/1095] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:30.983773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.017988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.018797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.019166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.019528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.075899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:31.099573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.101084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.130600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c8ac-8516-41cd-9a1d-03e6a836e2f1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.190269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.191641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.192134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.192621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.211198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.214536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:31.236479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:31.238346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:31.240124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:31.240124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:31.240124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:31.240124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:31.240124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 534/1096] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:31.240124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.247729 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 563/1097] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:57:31.252207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.289108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:31.359713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91bd06-c82b-4776-9ee3-936348cfad5a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.376976 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:31.396378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.397071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.397475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.397848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.403543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb9aa3-af25-4ef4-952b-51f4a974a6fb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.450206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.450909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.451188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.451463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.452193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:31.452500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.453915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.466554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 564/1098] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:31.469697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.480438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.481944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.543292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:31.592648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afe4f6-96c9-47f8-9d61-714ac2d5d4f8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.614746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 535/1099] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:57:31.615628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.648221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.649408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.649694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.650108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.651959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] RBAC: Authorizing `identity:get_project(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.653661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.661670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 565/1100] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:31.661670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.662666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:31.741060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652fab8-5eeb-4938-bc3e-214bb101663d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.779000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45faf-fbe4-423c-a912-6298a13f26cc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.779591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.779965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.780246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.780521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.787999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.789507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:57:31.804001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:31.805619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 536/1101] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:31.806996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.809356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:31.830275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.831563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.832020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.832474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.852874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.855804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:57:31.891031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:31.892724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:31.894557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:57:31.894557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:57:31.894557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:57:31.894557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:57:31.894557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 566/1102] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:31.895116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:31.940056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa292b7-d9ea-4213-aca5-7591faaccef9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:31.985462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:31.986147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:31.986419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:31.986691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:31.987601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71, user.id=e2df736c617f4c2cbccee0da21299979) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:31.987918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:31.989463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:31.997444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 537/1103] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/role_assignments?user.id=e2df736c617f4c2cbccee0da21299979&scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:31.998093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:32.018679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:32.116277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70072e5-c5e5-404e-bb63-222405e960a6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:32.121066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:32.182822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911d5d-a152-42d0-8047-ade804a8d921 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:32.185504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:32.186477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:32.187059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:32.187557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:32.188586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:32.189107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:32.191920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:32.209248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 567/1104] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:32.215655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:32.236185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:32.237395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:32.237926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:32.238419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:32.239541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:32.239920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:32.241471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f3232-fb50-46b4-822b-de1d58ec8fc1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:32.265112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 538/1105] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:32.395485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e0fd5-1e56-4120-a59f-f86189856b16 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:32.418502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:32.441480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:32.442255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:32.442675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:32.443091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:32.444164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] RBAC: Adding query filter params (role.id=d64cb70e7b5f4c6482648ed37df3ef1c, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=bd1a4928c641445e8b78a2836c680536) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:32.444606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:32.446353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c807a-aac8-4844-90ee-7761910a38a8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:32.454334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 568/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:32 2022] GET /identity/v3/role_assignments?user.id=bd1a4928c641445e8b78a2836c680536&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=d64cb70e7b5f4c6482648ed37df3ef1c => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:34.488231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a62271-5d63-4075-8c53-88acb3555e2d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:34.488830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a62271-5d63-4075-8c53-88acb3555e2d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:34.488830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a62271-5d63-4075-8c53-88acb3555e2d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:34.490245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 539/1107] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 13:57:34.496542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:34.497099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:34.497201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:34.517060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:34.518351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:34.594367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 569/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:34.620291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a62271-5d63-4075-8c53-88acb3555e2d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:34.734685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a62271-5d63-4075-8c53-88acb3555e2d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:34.762358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:34.771086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd839b-d663-4069-82bd-850e4e2ea5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:34.780552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd839b-d663-4069-82bd-850e4e2ea5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:34.780552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd839b-d663-4069-82bd-850e4e2ea5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:34.780552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd839b-d663-4069-82bd-850e4e2ea5c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:34.780552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd839b-d663-4069-82bd-850e4e2ea5c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:34.780552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd839b-d663-4069-82bd-850e4e2ea5c8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:34.780552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 540/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:34.783989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:34.901381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e2b9c-138a-430f-80d5-dff712abb409 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:34.914710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:34.940901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e66f2-bfd9-414e-945b-307660844651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:34.941591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e66f2-bfd9-414e-945b-307660844651 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:34.941865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e66f2-bfd9-414e-945b-307660844651 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:34.942143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e66f2-bfd9-414e-945b-307660844651 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:34.942853 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e66f2-bfd9-414e-945b-307660844651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:34.944302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e66f2-bfd9-414e-945b-307660844651 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:35.047524 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 570/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:57:34 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:37.480923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f43a-2123-4ec9-a9bf-4be4a3c5d0ca None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:37.481483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f43a-2123-4ec9-a9bf-4be4a3c5d0ca None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:37.481562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f43a-2123-4ec9-a9bf-4be4a3c5d0ca None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:37.482888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 541/1111] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:37.488905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:37.489387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:37.489387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:37.506678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:37.507885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:37.579108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 571/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:37.604184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f43a-2123-4ec9-a9bf-4be4a3c5d0ca None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:37.709437 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f43a-2123-4ec9-a9bf-4be4a3c5d0ca None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:37.745732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:37.746504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:37.746786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:37.747061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] PATH_INFO: `/v3/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:37.748543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] RBAC: Authorizing `identity:get_role(role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:37.749959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:37.751383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 542/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:37 2022] GET /identity/v3/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:37.760574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:37.872728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:37.878817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540f1d1-f947-492d-b799-4598edf74d56 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:37.916343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:37.917358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:37.917641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:37.917914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] PATH_INFO: `/v3/users/9d633c1889dc4275be175cb3e07b9436` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:37.932932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] RBAC: Authorizing `identity:get_user(user_id=9d633c1889dc4275be175cb3e07b9436)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:37.934396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:37.936586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 572/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:37 2022] GET /identity/v3/users/9d633c1889dc4275be175cb3e07b9436 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:37.942280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:38.022889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:38.063608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f5d7-d040-4b9d-83dd-a86b392b11e2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:38.109039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:38.109694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:38.109976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:38.110250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:38.180310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:38.181830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:38.244073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:38.284844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 543/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:57:38.291074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:38.395008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecb6f8-e37f-4e2f-88e3-338c2f455536 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:38.433484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506be2f8-4444-4d7e-a249-353a42b0f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:38.434361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506be2f8-4444-4d7e-a249-353a42b0f0ea None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:38.434641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506be2f8-4444-4d7e-a249-353a42b0f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:38.434917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506be2f8-4444-4d7e-a249-353a42b0f0ea None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:38.436204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506be2f8-4444-4d7e-a249-353a42b0f0ea None admin] RBAC: Authorizing `identity:get_project(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:38.437700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506be2f8-4444-4d7e-a249-353a42b0f0ea None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:38.439489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 573/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:38 2022] GET /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:38.446041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:38.546553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7862c6-a014-4523-82d2-90466b5399cf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:38.580755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:38.581435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:38.581745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:38.582021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:38.582845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] RBAC: Adding query filter params (role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71, user.id=9d633c1889dc4275be175cb3e07b9436) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:38.583155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:38.584583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6a65-6f2e-4a85-98a2-f537bb04ce79 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:38.590836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 544/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:38 2022] GET /identity/v3/role_assignments?user.id=9d633c1889dc4275be175cb3e07b9436&scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:40.894276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03c89-cc4e-4a69-9014-c7f8344d3dd3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:40.894825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03c89-cc4e-4a69-9014-c7f8344d3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:40.894825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed03c89-cc4e-4a69-9014-c7f8344d3dd3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:40.896213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 574/1118] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:40.902846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:40.903394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:40.903394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:40.926658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:40.927872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:40.952387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:41.001165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 545/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:41.024767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03c89-cc4e-4a69-9014-c7f8344d3dd3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:41.049346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:41.134874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed03c89-cc4e-4a69-9014-c7f8344d3dd3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:41.169917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:41.170768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:41.171042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:41.171307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] PATH_INFO: `/v3/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:41.172764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] RBAC: Authorizing `identity:get_role(role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:41.174138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:41.175517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 575/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:41 2022] GET /identity/v3/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:41.182368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:41.290311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848618b-c7b1-45dd-b235-3681f668b462 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:41.331948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:41.332827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:41.333109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:41.333380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] PATH_INFO: `/v3/users/9d633c1889dc4275be175cb3e07b9436` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:41.334555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] RBAC: Authorizing `identity:get_user(user_id=9d633c1889dc4275be175cb3e07b9436)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:41.335996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:41.337838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 546/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:41 2022] GET /identity/v3/users/9d633c1889dc4275be175cb3e07b9436 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:41.343540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:41.438836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:41.449633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda35c1-9d3b-451a-ba5e-2f39e6b43935 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:41.485888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce13fb6-eecf-43a9-97e3-1830cca2e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:41.486747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13fb6-eecf-43a9-97e3-1830cca2e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:41.487025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13fb6-eecf-43a9-97e3-1830cca2e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:41.487296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce13fb6-eecf-43a9-97e3-1830cca2e7b2 None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:41.488506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce13fb6-eecf-43a9-97e3-1830cca2e7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:41.490086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce13fb6-eecf-43a9-97e3-1830cca2e7b2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:41.491809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 576/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:41 2022] GET /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:41.498772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:41.533505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:41.613694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb676-f1ce-4a30-ac5b-ea20d381a943 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:41.651302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b615759-f745-4854-9fb1-b50de1920be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:41.652218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615759-f745-4854-9fb1-b50de1920be8 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:41.652495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615759-f745-4854-9fb1-b50de1920be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:41.652767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615759-f745-4854-9fb1-b50de1920be8 None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71/users/9d633c1889dc4275be175cb3e07b9436/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:41.655023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b615759-f745-4854-9fb1-b50de1920be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71, user_id=9d633c1889dc4275be175cb3e07b9436, role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:41.656461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b615759-f745-4854-9fb1-b50de1920be8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:41.749236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 547/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:57:41 2022] PUT /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71/users/9d633c1889dc4275be175cb3e07b9436/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:57:44.064079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59f5e0-e85d-4058-9306-36276436884c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:44.064646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59f5e0-e85d-4058-9306-36276436884c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:44.064646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59f5e0-e85d-4058-9306-36276436884c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:44.066012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 577/1124] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:44.071716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:44.072214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:44.072359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:44.090208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:44.091421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:44.160476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 548/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:44.185291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59f5e0-e85d-4058-9306-36276436884c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:44.292560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59f5e0-e85d-4058-9306-36276436884c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:44.328359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:44.329168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:44.329451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:44.329726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] PATH_INFO: `/v3/roles/68780b9c01b8468aa0dd652d5a010ba1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:44.331326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] RBAC: Authorizing `identity:get_role(role_id=68780b9c01b8468aa0dd652d5a010ba1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:44.332728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:44.334252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 578/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:44 2022] GET /identity/v3/roles/68780b9c01b8468aa0dd652d5a010ba1 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:44.341168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:44.358282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:44.445366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8788e-84ee-4e47-9c16-deb67898dc8e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:44.483817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:44.485093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:44.485577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:44.485982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] PATH_INFO: `/v3/users/9d633c1889dc4275be175cb3e07b9436` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:44.487757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=9d633c1889dc4275be175cb3e07b9436)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:44.489692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:44.491987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 549/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:44 2022] GET /identity/v3/users/9d633c1889dc4275be175cb3e07b9436 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:44.497868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:44.527446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:44.605879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f6957-355a-4611-9e32-5ddf71ed99fd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:44.645326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:44.645947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:44.646228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:44.646501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:44.719118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:44.720573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:44.748334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:44.822876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 579/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:57:44.828857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:44.912846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:44.930828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e129c0-748f-4a0a-9f6b-f119c199f2c3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:44.979589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b8ed7-5c2b-4ab4-a28b-2ba630b8e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:44.981071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b8ed7-5c2b-4ab4-a28b-2ba630b8e60d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:44.981563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b8ed7-5c2b-4ab4-a28b-2ba630b8e60d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:44.982042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b8ed7-5c2b-4ab4-a28b-2ba630b8e60d None admin] PATH_INFO: `/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:44.984086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b8ed7-5c2b-4ab4-a28b-2ba630b8e60d None admin] RBAC: Authorizing `identity:get_project(project_id=bc0eaf50eb7649bebddb60d9c3d1bc71)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:44.986742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b8ed7-5c2b-4ab4-a28b-2ba630b8e60d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:44.990152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 550/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:44 2022] GET /identity/v3/projects/bc0eaf50eb7649bebddb60d9c3d1bc71 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:44.997031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:45.103697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbfcb7-29e7-40c8-a1ca-cadf95f40b1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:45.131698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:45.141253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:45.141911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:45.142193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:45.143599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:45.143599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] RBAC: Adding query filter params (role.id=68780b9c01b8468aa0dd652d5a010ba1, scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71, user.id=9d633c1889dc4275be175cb3e07b9436) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:45.143599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:45.145008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e722f7-994a-4808-9eb3-efa5812eb23b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:45.151412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 580/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:44 2022] GET /identity/v3/role_assignments?user.id=9d633c1889dc4275be175cb3e07b9436&scope.project.id=bc0eaf50eb7649bebddb60d9c3d1bc71&role.id=68780b9c01b8468aa0dd652d5a010ba1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:47.461588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa43b3-5841-4f1d-91a0-5b81f94ce3dd None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:47.462274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa43b3-5841-4f1d-91a0-5b81f94ce3dd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:47.462274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa43b3-5841-4f1d-91a0-5b81f94ce3dd None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:47.463775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 551/1131] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:47.469845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:47.470407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:47.470407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:47.488492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:47.489651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:47.558131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 581/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:47.582120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa43b3-5841-4f1d-91a0-5b81f94ce3dd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:47.687138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa43b3-5841-4f1d-91a0-5b81f94ce3dd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:47.722017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ff113-5c9a-483b-b3ee-340953a1f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:47.722824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ff113-5c9a-483b-b3ee-340953a1f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:47.723099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ff113-5c9a-483b-b3ee-340953a1f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:47.723366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ff113-5c9a-483b-b3ee-340953a1f9b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:47.724632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ff113-5c9a-483b-b3ee-340953a1f9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:47.726170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ff113-5c9a-483b-b3ee-340953a1f9b0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:47.728464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 552/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:47.734665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:47.832243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4e25-451a-4361-82b5-07f23a1f2047 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:47.852252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:47.866384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20d53d-7fe3-4271-a00f-703fe784a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:47.867035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d53d-7fe3-4271-a00f-703fe784a76b None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:47.867313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d53d-7fe3-4271-a00f-703fe784a76b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:47.867582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d53d-7fe3-4271-a00f-703fe784a76b None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:47.868272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d53d-7fe3-4271-a00f-703fe784a76b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:47.869746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d53d-7fe3-4271-a00f-703fe784a76b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:47.984690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 582/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:57:47 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:57:50.359824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fcad9-8d19-413f-8c2c-694c47e450bc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:50.360377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fcad9-8d19-413f-8c2c-694c47e450bc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:50.360843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fcad9-8d19-413f-8c2c-694c47e450bc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:50.362523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 553/1135] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:50.369842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:50.370414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:50.370414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:50.390053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:50.391547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:50.463185 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 583/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:50.489760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fcad9-8d19-413f-8c2c-694c47e450bc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:50.512723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:50.624302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fcad9-8d19-413f-8c2c-694c47e450bc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:50.669696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ca35c-9a03-4957-8734-02d849439b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:50.670535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ca35c-9a03-4957-8734-02d849439b7b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:50.670811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ca35c-9a03-4957-8734-02d849439b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:50.671087 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ca35c-9a03-4957-8734-02d849439b7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:50.672470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ca35c-9a03-4957-8734-02d849439b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:50.673982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ca35c-9a03-4957-8734-02d849439b7b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:50.675701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 554/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:50.682092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:50.801802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a93c-fe76-47dc-b205-e274157b9910 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:50.803537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:50.840674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac60dd1-466f-4231-a8aa-5eab35f627cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:50.841389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac60dd1-466f-4231-a8aa-5eab35f627cc None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:50.841672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac60dd1-466f-4231-a8aa-5eab35f627cc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:50.841946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac60dd1-466f-4231-a8aa-5eab35f627cc None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:50.842664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac60dd1-466f-4231-a8aa-5eab35f627cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:50.844120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac60dd1-466f-4231-a8aa-5eab35f627cc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:50.948456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 584/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:57:50 2022] POST /identity/v3/users => generated 286 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 13:57:53.280982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37316a2-7da5-4083-acc2-b901eb3ee08a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:53.281557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37316a2-7da5-4083-acc2-b901eb3ee08a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:53.281557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37316a2-7da5-4083-acc2-b901eb3ee08a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:53.282863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 555/1139] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:53.288557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:53.289051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:53.289162 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:53.309203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:53.310419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:53.382082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 585/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:57:53.407328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37316a2-7da5-4083-acc2-b901eb3ee08a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:53.501425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:53.518328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37316a2-7da5-4083-acc2-b901eb3ee08a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:53.562206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:53.563001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:53.563276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:53.563548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:53.574325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:53.581956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:53.583134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:53.590011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 556/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:53.591285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:53.695945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:53.711913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936807c-4e1c-45c5-9747-32c4caf22cca None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:53.751820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:53.752422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:53.752712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:53.753037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:53.754134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:53.754659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:53.756524 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:53.766466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 586/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:53.773336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:53.893350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bbd47-7e16-4f15-b562-fc6af55f184f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:53.931531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:53.933049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:53.933337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:53.933620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] PATH_INFO: `/v3/users/e1813eaad1074c9ab013d0e2fa9a11ff` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:53.950286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] RBAC: Authorizing `identity:get_user(user_id=e1813eaad1074c9ab013d0e2fa9a11ff)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:53.951774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:53.953649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 557/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:53 2022] GET /identity/v3/users/e1813eaad1074c9ab013d0e2fa9a11ff => generated 286 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:53.959935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:54.069648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8b48b-028d-44df-a031-e20b866faac1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:54.120770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:54.121528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:54.121818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:54.122095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:54.152646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:54.208801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:54.210602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:54.318993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 587/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:57:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 13:57:54.325307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:54.329573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:54.427559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f93cf-057c-418e-8def-5954ed0b4931 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:54.463028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbc2d3-34ce-4a94-a0de-b80d85127aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:54.464090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc2d3-34ce-4a94-a0de-b80d85127aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:54.464362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc2d3-34ce-4a94-a0de-b80d85127aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:54.464636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbc2d3-34ce-4a94-a0de-b80d85127aa0 None admin] PATH_INFO: `/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:54.465861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc2d3-34ce-4a94-a0de-b80d85127aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=80de2a53a7ac410fbc55ed1d7961cab6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:54.467282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbc2d3-34ce-4a94-a0de-b80d85127aa0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:54.469020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 558/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:54 2022] GET /identity/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:54.475263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:54.530183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:54.581291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb68cb-e734-42c1-ae21-16d6b3fb95a1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:54.617170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:54.617832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:54.618116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:54.618432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:54.619351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=80de2a53a7ac410fbc55ed1d7961cab6, user.id=e1813eaad1074c9ab013d0e2fa9a11ff) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:54.619667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:54.621143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd349b4-a1ab-41ed-89e2-60fc90b8e22c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:54.626968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 588/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:57:54 2022] GET /identity/v3/role_assignments?user.id=e1813eaad1074c9ab013d0e2fa9a11ff&scope.project.id=80de2a53a7ac410fbc55ed1d7961cab6&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:56.885470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c216fe-dfcc-41d6-9533-a3a6a3703721 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:56.886048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c216fe-dfcc-41d6-9533-a3a6a3703721 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:56.886048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c216fe-dfcc-41d6-9533-a3a6a3703721 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:56.887378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 559/1147] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:57:56.893268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:56.893729 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:56.893843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:56.910809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:57:56.912016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:57:56.985722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 589/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:57:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:57:57.010335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c216fe-dfcc-41d6-9533-a3a6a3703721 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:57.083503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:57.114771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c216fe-dfcc-41d6-9533-a3a6a3703721 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:57.149770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:57.150463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:57.150746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:57.151021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:57.162006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:57:57.170593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:57:57.171862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:57:57.172889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 560/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:57:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:57:57.178299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:57.229069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:57.291626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7997-41d4-4fa4-85ea-8b92629ba75c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:57.328262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:57.328966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:57.329250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:57.329525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:57.330276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:57:57.330581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:57.331943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:57.343387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 590/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:57.349496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:57.458917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3b42a-c29a-4d06-8549-dea142de28c8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:57.488211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:57.493174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:57.494421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:57.494705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:57.494987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] PATH_INFO: `/v3/users/e1813eaad1074c9ab013d0e2fa9a11ff` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:57.496189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] RBAC: Authorizing `identity:get_user(user_id=e1813eaad1074c9ab013d0e2fa9a11ff)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:57.504993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:57.504993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 561/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:57:57 2022] GET /identity/v3/users/e1813eaad1074c9ab013d0e2fa9a11ff => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 13:57:57.505239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:57.617728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaafe02-e583-42be-84e8-9727883bb615 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:57.625222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:57:57.653393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d7e47-c31b-491e-ad21-a51fd729da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:57.654259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d7e47-c31b-491e-ad21-a51fd729da6b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:57.654540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d7e47-c31b-491e-ad21-a51fd729da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:57.654815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d7e47-c31b-491e-ad21-a51fd729da6b None admin] PATH_INFO: `/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:57.656216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d7e47-c31b-491e-ad21-a51fd729da6b None admin] RBAC: Authorizing `identity:get_project(project_id=80de2a53a7ac410fbc55ed1d7961cab6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:57.658076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d7e47-c31b-491e-ad21-a51fd729da6b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:57.660089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 591/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:57:57 2022] GET /identity/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:57:57.666563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:57:57.770312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb500a9-e517-4419-bb92-a03fe2abe754 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:57:57.804516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8379c7-6c0b-47e0-9dc2-d1d7f1628089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:57:57.805429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8379c7-6c0b-47e0-9dc2-d1d7f1628089 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:57:57.805750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8379c7-6c0b-47e0-9dc2-d1d7f1628089 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:57:57.806034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8379c7-6c0b-47e0-9dc2-d1d7f1628089 None admin] PATH_INFO: `/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6/users/e1813eaad1074c9ab013d0e2fa9a11ff/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:57:57.808142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8379c7-6c0b-47e0-9dc2-d1d7f1628089 None admin] RBAC: Authorizing `identity:create_grant(project_id=80de2a53a7ac410fbc55ed1d7961cab6, user_id=e1813eaad1074c9ab013d0e2fa9a11ff, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:57:57.809606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8379c7-6c0b-47e0-9dc2-d1d7f1628089 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:57:57.897463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 562/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:57:57 2022] PUT /identity/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6/users/e1813eaad1074c9ab013d0e2fa9a11ff/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:58:00.197751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e9f7-7376-4c27-94b4-79c816bff171 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:00.198330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e9f7-7376-4c27-94b4-79c816bff171 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:00.198330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e9f7-7376-4c27-94b4-79c816bff171 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:00.199672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 592/1154] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:00.205773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:00.206251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:00.206617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:00.230320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:00.231650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:00.308070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:00.319649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 563/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:00.347317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e9f7-7376-4c27-94b4-79c816bff171 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:00.456367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e9f7-7376-4c27-94b4-79c816bff171 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:00.490946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:00.491739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:00.492020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:00.492294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:00.508280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:58:00.516912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:58:00.518078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:58:00.519055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 593/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:58:00.524600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:00.626280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b37ef2-712b-41c8-8e34-0c6623fa33f9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:00.661384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:00.662070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:00.662348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:00.662619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:00.663369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:00.663673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:00.665115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:00.674177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 564/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:00.680125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:00.717183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:00.784017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86049e05-85fb-4de9-a13f-7b3868a85920 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:00.818316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:00.819189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:00.819474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:00.819751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] PATH_INFO: `/v3/users/e1813eaad1074c9ab013d0e2fa9a11ff` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:00.820958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] RBAC: Authorizing `identity:get_user(user_id=e1813eaad1074c9ab013d0e2fa9a11ff)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:00.822546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:00.824202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 594/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:58:00 2022] GET /identity/v3/users/e1813eaad1074c9ab013d0e2fa9a11ff => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:00.829936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:00.883987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:00.932235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4c699-8563-4331-8c39-5f04f5389161 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:00.970576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:00.971148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:00.971429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:00.971704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:01.037468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:01.038907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:01.088027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:01.134761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 565/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:58:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:58:01.140561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:01.240042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c2d0-1d71-41be-9b08-9be1f724153a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:01.241635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:01.275030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a44ab9-f779-4b95-bdad-e4986706894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:01.275887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a44ab9-f779-4b95-bdad-e4986706894e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:01.276167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a44ab9-f779-4b95-bdad-e4986706894e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:01.276439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a44ab9-f779-4b95-bdad-e4986706894e None admin] PATH_INFO: `/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:01.277817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a44ab9-f779-4b95-bdad-e4986706894e None admin] RBAC: Authorizing `identity:get_project(project_id=80de2a53a7ac410fbc55ed1d7961cab6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:01.279240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a44ab9-f779-4b95-bdad-e4986706894e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:01.280969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 595/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:58:01 2022] GET /identity/v3/projects/80de2a53a7ac410fbc55ed1d7961cab6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:01.287049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:01.384120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0b9d-feda-40eb-83d6-d18839adfd1f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:01.418026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:01.418672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:01.418954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:01.419323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:01.420045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=80de2a53a7ac410fbc55ed1d7961cab6, user.id=e1813eaad1074c9ab013d0e2fa9a11ff) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:01.420354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:01.421818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2cc3f-0332-48c4-8c7c-d3c9623e0730 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:01.427570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 566/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:58:01 2022] GET /identity/v3/role_assignments?user.id=e1813eaad1074c9ab013d0e2fa9a11ff&scope.project.id=80de2a53a7ac410fbc55ed1d7961cab6&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:03.722388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0daa-30ed-4e82-8ee5-41f898b54d72 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:03.722971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0daa-30ed-4e82-8ee5-41f898b54d72 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:03.722971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0daa-30ed-4e82-8ee5-41f898b54d72 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:03.724310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 596/1162] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:03.730152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:03.730582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:03.730682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:03.747763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:03.748986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:03.760644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:03.816751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 567/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:03.839146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0daa-30ed-4e82-8ee5-41f898b54d72 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:03.942045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0daa-30ed-4e82-8ee5-41f898b54d72 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:03.976089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:03.976655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:03.976967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:03.977245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:04.017770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:04.046535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:04.048006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:04.145270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 597/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:58:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:58:04.151901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:04.250648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b718b85-27b7-4998-bb76-76cefa4e9451 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:04.285108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:04.285901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:04.286182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:04.286454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:04.293777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:04.295206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cded31b9-d6c5-40d6-8e2f-a80c87fe8500 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:58:04.309127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:58:04.310424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:58:04.311565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 568/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 13:58:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:58:04.316300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:04.383870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:04.414364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2fead-6457-4d3c-84fa-89d35381fc1f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:04.447702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:04.448357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:04.448639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:04.448947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:04.449661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:04.449965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:04.451324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8144-0152-417a-943b-92b1c5e97ebf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:04.458330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 598/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Wed May 18 13:58:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:06.717987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854d2a1-e7bb-408a-b66d-50513e1db1dc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:06.718540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854d2a1-e7bb-408a-b66d-50513e1db1dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:06.718540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854d2a1-e7bb-408a-b66d-50513e1db1dc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:06.719877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 569/1167] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:06.725112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95da0-1d2b-4732-80d5-ce5987df2553 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:06.725507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95da0-1d2b-4732-80d5-ce5987df2553 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:06.725664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95da0-1d2b-4732-80d5-ce5987df2553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:06.742255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3cb95da0-1d2b-4732-80d5-ce5987df2553 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:06.743983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3cb95da0-1d2b-4732-80d5-ce5987df2553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:06.810771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 599/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:06.833688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854d2a1-e7bb-408a-b66d-50513e1db1dc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:06.843143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:06.937800 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854d2a1-e7bb-408a-b66d-50513e1db1dc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:06.970764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e237b07-7c51-4ce1-ad43-70a0f9d87213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:06.971335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237b07-7c51-4ce1-ad43-70a0f9d87213 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:06.971617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237b07-7c51-4ce1-ad43-70a0f9d87213 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:06.971891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e237b07-7c51-4ce1-ad43-70a0f9d87213 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:06.972628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e237b07-7c51-4ce1-ad43-70a0f9d87213 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:06.974022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e237b07-7c51-4ce1-ad43-70a0f9d87213 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:07.045253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 570/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Wed May 18 13:58:06 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:58:09.290963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317577-9c71-40eb-ad6c-92eb88b5ad46 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:09.291522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317577-9c71-40eb-ad6c-92eb88b5ad46 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:09.291522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e317577-9c71-40eb-ad6c-92eb88b5ad46 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:09.292906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 600/1170] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:09.298359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:09.298816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:09.298922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:09.319400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:09.320606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:09.392482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:09.400375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 571/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:09.424920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e317577-9c71-40eb-ad6c-92eb88b5ad46 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:09.490048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:09.530565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e317577-9c71-40eb-ad6c-92eb88b5ad46 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:09.564221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576dd73-9fbc-4e0a-9bce-2f028b72de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:09.565112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dd73-9fbc-4e0a-9bce-2f028b72de13 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:09.565394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dd73-9fbc-4e0a-9bce-2f028b72de13 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:09.565666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576dd73-9fbc-4e0a-9bce-2f028b72de13 None admin] PATH_INFO: `/v3/domains/38c75af6a4964007ab2d983e91e659b6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:09.577211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576dd73-9fbc-4e0a-9bce-2f028b72de13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38c75af6a4964007ab2d983e91e659b6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:09.578651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576dd73-9fbc-4e0a-9bce-2f028b72de13 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:09.580329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 601/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Wed May 18 13:58:09 2022] GET /identity/v3/domains/38c75af6a4964007ab2d983e91e659b6 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:09.586357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:09.690291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4c816-b690-461d-9c4d-af05d6279f30 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:09.727077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39eb83-6efc-4913-9ab0-7c9e4291726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:09.728327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39eb83-6efc-4913-9ab0-7c9e4291726f None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:09.728616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39eb83-6efc-4913-9ab0-7c9e4291726f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:09.728912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39eb83-6efc-4913-9ab0-7c9e4291726f None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:09.729642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39eb83-6efc-4913-9ab0-7c9e4291726f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:09.731128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39eb83-6efc-4913-9ab0-7c9e4291726f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:09.824665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 572/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 13:58:09 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:58:12.094307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62682f2-0b24-4fbe-80cd-34285458fecb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:12.094870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62682f2-0b24-4fbe-80cd-34285458fecb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:12.094870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62682f2-0b24-4fbe-80cd-34285458fecb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:12.096216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 602/1174] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:12.101607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:12.102057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:12.102159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:12.120849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:12.122067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:12.166786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:12.191063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 573/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:12.216939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62682f2-0b24-4fbe-80cd-34285458fecb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:12.321467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62682f2-0b24-4fbe-80cd-34285458fecb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:12.344623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:12.355595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21371721-8a59-4d41-870d-e45c209e5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:12.364370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21371721-8a59-4d41-870d-e45c209e5e60 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:12.364370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21371721-8a59-4d41-870d-e45c209e5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:12.364370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21371721-8a59-4d41-870d-e45c209e5e60 None admin] PATH_INFO: `/v3/domains/38c75af6a4964007ab2d983e91e659b6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:12.364370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21371721-8a59-4d41-870d-e45c209e5e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38c75af6a4964007ab2d983e91e659b6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:12.364370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21371721-8a59-4d41-870d-e45c209e5e60 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:12.364370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 603/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Wed May 18 13:58:12 2022] GET /identity/v3/domains/38c75af6a4964007ab2d983e91e659b6 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:12.367426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:12.472717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33303600-9ac7-4b44-9983-5d74aaeff90b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:12.520520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed8a03-2f8c-45fd-aedb-0fe840b9f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:12.521235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8a03-2f8c-45fd-aedb-0fe840b9f610 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:12.521513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8a03-2f8c-45fd-aedb-0fe840b9f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:12.521782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed8a03-2f8c-45fd-aedb-0fe840b9f610 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:12.522496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed8a03-2f8c-45fd-aedb-0fe840b9f610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:12.523964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed8a03-2f8c-45fd-aedb-0fe840b9f610 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:12.611529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 574/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:58:12 2022] POST /identity/v3/users => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:58:14.880596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ef36-fbc1-420c-b25b-2a862fd897c5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:14.881186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ef36-fbc1-420c-b25b-2a862fd897c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:14.881186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5ef36-fbc1-420c-b25b-2a862fd897c5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:14.882537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 604/1178] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:14.887905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:14.888334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:14.888438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:14.906212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:14.907398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:14.934709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:14.976337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 575/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:15.000686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ef36-fbc1-420c-b25b-2a862fd897c5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:15.103557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5ef36-fbc1-420c-b25b-2a862fd897c5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:15.138528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:15.139232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:15.139512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:15.139783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:15.150545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:58:15.158082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:58:15.159206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:58:15.160367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 605/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:58:15.165503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:15.268325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc40d-d6e5-4514-bd2b-0085f8899307 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:15.347380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:15.348057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:15.348343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:15.348615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:15.349414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:15.349721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:15.351121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:15.360970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 576/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:15.366828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:15.421885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:15.471083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2b77a-8f81-4e59-842a-701fe2e4a718 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:15.504698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:15.505588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:15.505865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:15.506135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] PATH_INFO: `/v3/users/b7caf47499cf47f1bac1b070f27dc170` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:15.519905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=b7caf47499cf47f1bac1b070f27dc170)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:15.521381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:15.523028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 606/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:58:15 2022] GET /identity/v3/users/b7caf47499cf47f1bac1b070f27dc170 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:15.528890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:15.557091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:15.627304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283867-2290-4e7b-a70d-562a2a7c0fef None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:15.661835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:15.662469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:15.662747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:15.663015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:15.730212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:15.731580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:15.757240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:15.830877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 577/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:58:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:58:15.836954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:15.933424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8f6b2-d395-4e23-b445-fd7715509ea5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:15.943860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:15.967059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47b0df-cff1-4e28-9cdb-488a492ac936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:15.967916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47b0df-cff1-4e28-9cdb-488a492ac936 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:15.968201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47b0df-cff1-4e28-9cdb-488a492ac936 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:15.968561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47b0df-cff1-4e28-9cdb-488a492ac936 None admin] PATH_INFO: `/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:15.969757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47b0df-cff1-4e28-9cdb-488a492ac936 None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3e377eb3844a4a1563ddbe6e6f73f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:15.971164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47b0df-cff1-4e28-9cdb-488a492ac936 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:15.972872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 607/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:58:15 2022] GET /identity/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:15.979873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:16.079612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11fe5-3d7f-40c8-80bc-7b534c884728 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:16.105209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:16.113282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:16.117066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:16.117066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:16.117066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:16.117066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=4dc3e377eb3844a4a1563ddbe6e6f73f, user.id=b7caf47499cf47f1bac1b070f27dc170) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:16.117066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:16.117066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b0c8-a051-468e-8234-c6f233ecdb08 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:16.123172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 578/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:58:15 2022] GET /identity/v3/role_assignments?user.id=b7caf47499cf47f1bac1b070f27dc170&scope.project.id=4dc3e377eb3844a4a1563ddbe6e6f73f&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:18.375173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1162f-6bd1-4ee8-bfb0-2fa93480cb12 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:18.375750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1162f-6bd1-4ee8-bfb0-2fa93480cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:18.375750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1162f-6bd1-4ee8-bfb0-2fa93480cb12 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:18.377126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 608/1186] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:18.382532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:18.382969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:18.383066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:18.401279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:18.402477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:18.471773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 579/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 13:58:18.496110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1162f-6bd1-4ee8-bfb0-2fa93480cb12 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:18.598549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1162f-6bd1-4ee8-bfb0-2fa93480cb12 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:18.632664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:18.633872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:18.633872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:18.634648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:18.644996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:58:18.653228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:58:18.654455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:58:18.655592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 609/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:58:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:58:18.660680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:18.784161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266390f9-6ddb-4920-b169-f729994d05dd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:18.806241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:18.821464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:18.823732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:18.823732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:18.823732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:18.823732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:18.823732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:18.825163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:18.834251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 580/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:58:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:18.841174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:18.882741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:18.947612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ef80-825c-4796-aa69-5d7d50b6b622 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:18.981378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:18.982246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:18.982527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:18.982797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] PATH_INFO: `/v3/users/b7caf47499cf47f1bac1b070f27dc170` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:18.983978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] RBAC: Authorizing `identity:get_user(user_id=b7caf47499cf47f1bac1b070f27dc170)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:18.985570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:18.987408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 610/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:58:18 2022] GET /identity/v3/users/b7caf47499cf47f1bac1b070f27dc170 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:18.994794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:19.107001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ff9b-f7f4-4e12-876e-e058b402e074 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:19.141045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d90862-164e-42b2-b44a-17f0e9671e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:19.142156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d90862-164e-42b2-b44a-17f0e9671e7c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:19.142433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d90862-164e-42b2-b44a-17f0e9671e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:19.142718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d90862-164e-42b2-b44a-17f0e9671e7c None admin] PATH_INFO: `/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:19.143876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d90862-164e-42b2-b44a-17f0e9671e7c None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3e377eb3844a4a1563ddbe6e6f73f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:19.145403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d90862-164e-42b2-b44a-17f0e9671e7c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:19.147102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 581/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:58:18 2022] GET /identity/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:19.153180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:19.253259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39340-6117-4b3b-9cff-cb21810219bd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:19.262159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:19.288568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4d6c-7b02-4b23-81bc-02f6464675be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:19.289718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4d6c-7b02-4b23-81bc-02f6464675be None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:19.290494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4d6c-7b02-4b23-81bc-02f6464675be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:19.290857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4d6c-7b02-4b23-81bc-02f6464675be None admin] PATH_INFO: `/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f/users/b7caf47499cf47f1bac1b070f27dc170/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:19.293368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4d6c-7b02-4b23-81bc-02f6464675be None admin] RBAC: Authorizing `identity:create_grant(project_id=4dc3e377eb3844a4a1563ddbe6e6f73f, user_id=b7caf47499cf47f1bac1b070f27dc170, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:19.294784 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4d6c-7b02-4b23-81bc-02f6464675be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:19.421576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 611/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:58:19 2022] PUT /identity/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f/users/b7caf47499cf47f1bac1b070f27dc170/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 13:58:21.751881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcf55a-d3b1-4bca-8047-270d97023854 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:21.752462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcf55a-d3b1-4bca-8047-270d97023854 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:21.752462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcf55a-d3b1-4bca-8047-270d97023854 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:21.753810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 582/1193] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:58:21.759902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:21.760339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:21.760446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:21.777289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:58:21.778474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:58:21.845984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 612/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:58:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:58:21.870708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcf55a-d3b1-4bca-8047-270d97023854 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:21.927917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:21.979979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcf55a-d3b1-4bca-8047-270d97023854 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:22.015048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:22.015761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:22.016037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:22.016311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:22.034551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:58:22.043765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:58:22.045100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:58:22.046125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 583/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 13:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:58:22.052612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:22.155278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:22.161228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc6a68-2813-4ad1-bdbb-62799c7282fe None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:22.197429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:22.198113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:22.198391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:22.198665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:22.199412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:22.199721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:22.201131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:22.210380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 613/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 13:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:22.217233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:22.320161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0903e0-61c6-403b-a418-ab424020d86f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:22.337780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:22.362897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:22.363756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:22.364035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:22.364307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] PATH_INFO: `/v3/users/b7caf47499cf47f1bac1b070f27dc170` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:22.365458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] RBAC: Authorizing `identity:get_user(user_id=b7caf47499cf47f1bac1b070f27dc170)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:22.366897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:22.368692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 584/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Wed May 18 13:58:22 2022] GET /identity/v3/users/b7caf47499cf47f1bac1b070f27dc170 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:22.374628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:22.493665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab966008-5796-4421-ace3-a95dd2c4d3ac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:22.527815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23130086-ba32-4cff-b997-9871538b998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:22.528451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23130086-ba32-4cff-b997-9871538b998d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:22.528727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23130086-ba32-4cff-b997-9871538b998d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:22.529027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23130086-ba32-4cff-b997-9871538b998d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:22.561029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:22.605964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23130086-ba32-4cff-b997-9871538b998d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:22.607332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23130086-ba32-4cff-b997-9871538b998d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:22.705248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 614/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:58:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:58:22.711198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:22.820230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba853-d211-4dd9-b91e-32c2a18c9e59 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:22.854545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7fa1b-35b3-4784-b0be-b26f7c314bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:22.855393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7fa1b-35b3-4784-b0be-b26f7c314bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:22.855668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7fa1b-35b3-4784-b0be-b26f7c314bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:22.855937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7fa1b-35b3-4784-b0be-b26f7c314bc9 None admin] PATH_INFO: `/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:22.857166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7fa1b-35b3-4784-b0be-b26f7c314bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=4dc3e377eb3844a4a1563ddbe6e6f73f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:22.858543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7fa1b-35b3-4784-b0be-b26f7c314bc9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:22.860222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 585/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Wed May 18 13:58:22 2022] GET /identity/v3/projects/4dc3e377eb3844a4a1563ddbe6e6f73f => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:22.866261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23130086-ba32-4cff-b997-9871538b998d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:58:22.928463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:22.969883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23130086-ba32-4cff-b997-9871538b998d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:58:23.003557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:58:23.004206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:58:23.004485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:58:23.004758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:58:23.005689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=4dc3e377eb3844a4a1563ddbe6e6f73f, user.id=b7caf47499cf47f1bac1b070f27dc170) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:58:23.005999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:58:23.007423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6240d93-0ba6-4127-94c7-0f3fffd1ce63 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:58:23.013577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 615/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:58:22 2022] GET /identity/v3/role_assignments?user.id=b7caf47499cf47f1bac1b070f27dc170&scope.project.id=4dc3e377eb3844a4a1563ddbe6e6f73f&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:58:32.850025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=77 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:58:33.010791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=39 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:48.186671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84be5-861d-456b-9183-4f7453edc8ee None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:48.187351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84be5-861d-456b-9183-4f7453edc8ee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:48.187351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84be5-861d-456b-9183-4f7453edc8ee None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:48.188579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 586/1201] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:59:48.194655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:48.197007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:48.197007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:48.213820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:59:48.215192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:59:48.290544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 616/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:59:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:59:48.316619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84be5-861d-456b-9183-4f7453edc8ee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:48.421862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84be5-861d-456b-9183-4f7453edc8ee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:48.458553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:48.459775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:48.460054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:48.460326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:48.470531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:48.471981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:59:48.490353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:48.491574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:48.492579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:59:48.492579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:59:48.492579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:48.492579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:59:48.492579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 587/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:48.498120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:48.611381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b18e0f-58bc-448d-bd89-45f406f79e1a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:48.641741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:48.648703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:48.649406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:48.649689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:48.649973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:48.650687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:48.650987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:48.652387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d3f9d-a3f8-43a8-8298-c4737348e615 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:48.664731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 617/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:48.670531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:48.723458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:48.770216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04c0f-01f7-41af-819b-1e17f3908265 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:48.804080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312c51-5320-47e4-8be4-91ce8159d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:48.804777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312c51-5320-47e4-8be4-91ce8159d310 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:48.805083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312c51-5320-47e4-8be4-91ce8159d310 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:48.805357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312c51-5320-47e4-8be4-91ce8159d310 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:48.806062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312c51-5320-47e4-8be4-91ce8159d310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:48.807490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312c51-5320-47e4-8be4-91ce8159d310 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:48.971711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 588/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Wed May 18 13:59:48 2022] POST /identity/v3/users => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 13:59:51.243395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766ac9-35cc-43dc-84ac-76295d81343e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:51.244594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766ac9-35cc-43dc-84ac-76295d81343e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:51.244594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23766ac9-35cc-43dc-84ac-76295d81343e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:51.245347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 618/1206] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:59:51.250774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:51.251228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:51.251342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:51.270372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:59:51.271589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:59:51.342593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 589/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:59:51.368303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766ac9-35cc-43dc-84ac-76295d81343e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:51.477211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23766ac9-35cc-43dc-84ac-76295d81343e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:51.511297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:51.511990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:51.512296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:51.512566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:51.524267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:59:51.532013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:51.533199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:51.534145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 619/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:59:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:51.540415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:51.580803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:51.644585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49140137-a162-4a9f-adc2-22c1d54fe8e8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:51.680414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:51.681101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:51.681381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:51.681656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:51.682398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:51.682703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:51.684219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:51.692114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 590/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:59:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:51.697986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:51.758655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:51.809176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdc10-3436-46e5-a8ef-7a21c28a88fb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:51.843797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:51.844582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:51.844898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:51.845179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:51.855858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:51.857900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:59:51.875153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:51.876274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:51.877306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:59:51.877306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:59:51.877306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:51.877306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:51.877306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 620/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:51.882645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:51.988054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:51.991431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b22e-cf98-4030-9609-c1e9a7a49956 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:52.030650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:52.031311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:52.031601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:52.031881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:52.032600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:52.032937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:52.034305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:52.046177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 591/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:52.051849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:52.156651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de95940-a4f0-459f-934d-c11f6cbb2a07 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:52.158287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:52.194944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:52.195755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:52.196039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:52.196315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:52.203971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:52.205460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:59:52.221196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:52.224564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:52.225932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 621/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:52.229584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:52.342811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ec44-4cbb-44d5-8cfb-fe6d03f26ffc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:52.378411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:52.379133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:52.379416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:52.379688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:52.380529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:52.380863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:52.382895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:52.401799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 592/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Wed May 18 13:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:52.410862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:52.518981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a330-f891-4ac2-926e-405b771c62b0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:52.554680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:52.556320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:52.556320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:52.556320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:52.587894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:52.629079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:52.630545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:52.733677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 622/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 13:59:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 13:59:52.739504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:52.759026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:52.838604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be23c8-8cc6-4f3e-87fa-148bb9b9cddf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:52.875557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:52.876365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:52.876649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:52.876956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:52.890292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:52.892923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:59:52.915522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:52.916718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:52.917708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:59:52.917708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:59:52.917708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:52.917708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:59:52.917708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 593/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:52.922529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:52.985511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:53.024803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157ed44-f1d1-4477-9ca0-9fa49ee0234f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:53.059753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:53.060461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:53.060744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:53.061054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:53.061775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:53.062075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:53.063447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:53.075505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 623/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:53.084519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:53.158072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:53.188441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb28db-125b-4c33-bfd9-09b397f423f7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:53.224642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:53.226665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:53.226974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:53.227250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:53.234621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:53.236161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:59:53.250354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:53.251502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 13:59:53.257646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 594/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:59:53.258993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:53.363237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87ec0-377b-4226-87fa-854f02966ed4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:53.389994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:53.403170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:53.403824 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:53.404103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:53.404373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:53.405246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:53.405552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:53.406969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87dc3d-17d2-4555-a5aa-8beb0350fdf2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:53.419153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 624/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:53.425350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:53.530510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fa6b-9060-4bc7-98fa-aaac344fa9f5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:53.559102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:53.564912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:53.565571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:53.565854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:53.566130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:53.567029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=6d5153b7c1af4b7285ada5dba9316416) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:53.567342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:53.569350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27adf0-de2e-406f-927a-8917f87deb2d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:53.575129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 595/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 13:59:53 2022] GET /identity/v3/role_assignments?user.id=6d5153b7c1af4b7285ada5dba9316416&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:55.818253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6003e-3b5d-4e11-9884-23c38d0dae90 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:55.818842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6003e-3b5d-4e11-9884-23c38d0dae90 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:55.818842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6003e-3b5d-4e11-9884-23c38d0dae90 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:55.820183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 625/1220] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 13:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 13:59:55.825511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:55.825979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:55.826088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:55.842940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 13:59:55.844152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 13:59:55.914763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 596/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 13:59:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 13:59:55.938044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6003e-3b5d-4e11-9884-23c38d0dae90 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:56.042987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6003e-3b5d-4e11-9884-23c38d0dae90 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:56.077508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:56.078219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:56.078494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:56.078765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:56.089930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 13:59:56.097681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:56.102002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:56.103122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 626/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 13:59:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:56.106129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:56.206354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe029d72-98dd-498a-b283-c583e85d2815 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:56.233390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:56.244611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:56.245338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:56.245591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:56.245857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:56.246597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:56.246895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:56.248247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:56.257821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 597/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 13:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:56.263839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:56.309119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:56.367202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9779ef-24d2-4eec-80bb-357e29a8c9e0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:56.402566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:56.404847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:56.404847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:56.404847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:56.416004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:56.417676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:59:56.436851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:56.442114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:56.443975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:59:56.443975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:59:56.443975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:56.443975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:56.443975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 627/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:56.445047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:56.549604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dae1f-415a-4eb8-bc78-cce0d3a11960 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:56.587835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:56.588516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:56.588826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:56.589103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:56.589837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:56.590147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:56.591613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:56.604815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 598/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:56.610585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:56.708536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:56.715439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2c92b-0187-479c-9a70-5f6bdfd4e429 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:56.750119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:56.750912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:56.751192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:56.751466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:56.759899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:56.761372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 13:59:56.781723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:56.785026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:56.787214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 628/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:56.793195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:56.848476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:56.903648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5138eb-4b58-45cb-bedd-6a4290cef708 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:56.938172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:56.938846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:56.939130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:56.939406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:56.940276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:56.940587 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:56.942073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:56.961487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 599/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Wed May 18 13:59:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:56.967086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:57.077756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73523622-8df4-43bd-90ac-0fb8ac414531 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:57.118447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:57.119225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:57.119505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:57.119775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:57.129834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:57.132092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 13:59:57.151379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:57.152543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:57.153517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 13:59:57.153517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 13:59:57.153517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 13:59:57.153517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:57.153517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 629/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 13:59:57.160155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:57.263776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8b75e-bd39-4229-83c8-f673fa693696 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:57.266295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:57.298866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:57.299550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:57.299828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:57.300100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:57.300844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:57.301150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:57.302539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:57.314019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 600/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:57.320335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:57.329781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:57.424242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd72a-fd0e-4f46-be52-d38b958c7eff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:57.461672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:57.462462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:57.462745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:57.463013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:57.469787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:57.471288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 13:59:57.484960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 13:59:57.486039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 13:59:57.493270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 630/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 13:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 13:59:57.494241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:57.604221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28a4de-d5c8-4c3b-9d2b-10d782b196bc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:57.638267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:57.638917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:57.639191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:57.639459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:57.640231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 13:59:57.640534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:57.642037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307a42f-0b49-4001-b47f-3978bcb2a826 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:57.654799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 601/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 13:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 13:59:57.660998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 13:59:57.732160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 13:59:57.767819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c07291-e58c-44c4-a3af-c9299775922d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 13:59:57.806433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e15c87-75f8-4006-8303-3d572d0b57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 13:59:57.807331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15c87-75f8-4006-8303-3d572d0b57a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 13:59:57.807608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15c87-75f8-4006-8303-3d572d0b57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 13:59:57.807880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15c87-75f8-4006-8303-3d572d0b57a7 None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/6d5153b7c1af4b7285ada5dba9316416/roles/000aaa0072a64ac680bcea57f43401a8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 13:59:57.824102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e15c87-75f8-4006-8303-3d572d0b57a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=6d5153b7c1af4b7285ada5dba9316416, role_id=000aaa0072a64ac680bcea57f43401a8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 13:59:57.825589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e15c87-75f8-4006-8303-3d572d0b57a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 13:59:57.959468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 631/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 13:59:57 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/6d5153b7c1af4b7285ada5dba9316416/roles/000aaa0072a64ac680bcea57f43401a8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:00:00.215669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6621cd-3597-4a55-9866-9c2b5439d9ca None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:00.216294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6621cd-3597-4a55-9866-9c2b5439d9ca None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:00.216294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6621cd-3597-4a55-9866-9c2b5439d9ca None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:00.217606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 602/1233] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:00.222663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:00.223054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:00.223211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:00.240221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:00.241453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:00.308406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 632/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:00.332883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6621cd-3597-4a55-9866-9c2b5439d9ca None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:00.358859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:00.436167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6621cd-3597-4a55-9866-9c2b5439d9ca None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:00.470557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:00.471270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:00.471557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:00.472374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:00.485957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:00:00.494477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:00.495649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:00.496881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 603/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Wed May 18 14:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:00.501937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:00.548314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:00.601582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaecf5-a6ec-4339-921d-82878a82f986 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:00.635317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:00.635965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:00.636295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:00.636574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:00.637414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:00.637723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:00.639075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:00.647305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 633/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Wed May 18 14:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:00.653385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:00.739402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:00.755489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a38c9-84d7-4e5c-86d7-1384592c4e78 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:00.790296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:00.791081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:00.791456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:00.791685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:00.801511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:00.803664 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:00.821648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:00.822654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:00.823552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:00.823552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:00.823552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:00.823552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:00.823552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 604/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:00.828802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:00.931367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9206b6-c857-4b3e-887a-e0533c717d3d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:00.940299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:00.964253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:00.964936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:00.965264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:00.965533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:00.966247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:00.966548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:00.967957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:00.980333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 634/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:00.985979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:01.086153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e628-ce08-430b-bd2d-5a8611029f39 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:01.121728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:01.122529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:01.122805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:01.123076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:01.125799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:01.130347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:01.132004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:00:01.147477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:01.148632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:01.149801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 605/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:01.154646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:01.256215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127fee-c479-467d-ab32-8139195f1989 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:01.293915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:01.294577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:01.294857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:01.295131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:01.295952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:01.296258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:01.297700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:01.315040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 635/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Wed May 18 14:00:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:01.320930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:01.419380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0673e9-f22f-406a-8394-cf17074a1ee3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:01.454045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:01.454727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:01.455036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:01.455332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:01.515677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:01.523041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:01.524543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:01.629488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 606/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 14:00:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:00:01.636209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:01.665167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:01.742706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2539f6-ac84-4b7e-926a-d55c7c394d4a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:01.779796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:01.780725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:01.781063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:01.781336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:01.791994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:01.793549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:01.812673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:01.814501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:01.815610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:01.815610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:01.815610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:01.815610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:01.819217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 636/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:01.820413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:01.913633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:01.919511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6440ed-ca17-4d12-aa8d-f0ed2941c185 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:01.954310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:01.954968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:01.955245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:01.955515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:01.956306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:01.956608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:01.958012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:01.969276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 607/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:01.975144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:02.058360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:02.079514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85b89e-275d-4677-b41d-0da2bcc641f5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:02.117981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:02.118766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:02.119047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:02.119323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:02.126066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:02.127501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:00:02.142191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:02.143248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:02.144728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 637/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 14:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:02.149937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:02.264863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4a3a-aed8-4620-ae35-337fdfce88a2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:02.300891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:02.301543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:02.301823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:02.302090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:02.303504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:02.303808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:02.305465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3ee30-e0ec-4881-b62d-ed5b19c45dc4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:02.318110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 608/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 14:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:02.324272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:02.432655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612a427-ac48-413a-b480-526557aa9782 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:02.470560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:02.471209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:02.471488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:02.471765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:02.472583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] RBAC: Adding query filter params (role.id=000aaa0072a64ac680bcea57f43401a8, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=6d5153b7c1af4b7285ada5dba9316416) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:02.473048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:02.474909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470027f8-fab1-4a30-a2c6-bc5b842b55b0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:02.480880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 638/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 14:00:02 2022] GET /identity/v3/role_assignments?user.id=6d5153b7c1af4b7285ada5dba9316416&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=000aaa0072a64ac680bcea57f43401a8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:04.825678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48788bd-b999-4a46-8996-9fb2bb448581 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:04.826261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48788bd-b999-4a46-8996-9fb2bb448581 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:04.826261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48788bd-b999-4a46-8996-9fb2bb448581 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:04.827676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 609/1247] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:04.836048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:04.836503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:04.836704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:04.841750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:04.853880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:04.855096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:04.923663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 639/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 14:00:04.948913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48788bd-b999-4a46-8996-9fb2bb448581 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:04.967707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:05.051663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48788bd-b999-4a46-8996-9fb2bb448581 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:05.087044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:05.087758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:05.088036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:05.088303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:05.098752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:00:05.106712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:05.107893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:05.108915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 610/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 14:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:05.114047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:05.214253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02f57c-3ab2-4671-b5df-e196faef58ee None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:05.244143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:05.249084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:05.249748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:05.250022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:05.250287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:05.251008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:05.251306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:05.252705 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:05.261649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 640/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 14:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:05.267670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:05.346054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:05.369441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d1045-734e-4a90-80a6-733d4b7b1c75 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:05.407666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:05.408515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:05.408900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:05.409257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:05.423597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:05.425813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:05.450881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:05.452068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:05.453123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:05.453123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:05.453123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:05.453123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:05.453123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 611/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:05.458522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:05.560203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e89a8-51a6-4565-a6fb-a5322fe0849e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:05.594014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:05.594671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:05.594953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:05.595228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:05.595937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:05.596293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:05.597674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:05.611507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 641/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:05.618429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:05.719197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740235fc-f5c7-4201-8a25-475a4914e304 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:05.745561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:05.753268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:05.754058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:05.754333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:05.754600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:05.762106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:05.763535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:00:05.778236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:05.779444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:05.780649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 612/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:05.785369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:05.840362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:05.886060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b7dcf-ea30-485b-b8ed-0b4567615c56 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:05.921249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:05.921906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:05.922185 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:05.922456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:05.923364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:05.923672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:05.925119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:05.942091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 642/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Wed May 18 14:00:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:05.948231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:06.054504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f5c6-d259-4bd4-9de7-395f86890f10 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:06.089752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:06.090393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:06.090671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:06.091010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:06.147873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:06.159807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:06.161299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:06.258417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 613/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 14:00:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:00:06.264411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:06.363700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbc80f-0b35-49cd-aeb0-2af2b0c7df5d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:06.378073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:06.400199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:06.401020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:06.401300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:06.401573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:06.411558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:06.413392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:06.431501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:06.432667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:06.433909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:06.433909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:06.433909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:06.433909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:06.433909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 643/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:06.438658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:06.525672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:06.537247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59f9b1-f6a0-4fde-bdd8-2889acbe7da1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:06.570695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:06.571356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:06.571636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:06.571911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:06.572622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:06.572957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:06.574355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:06.585285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 614/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:06.591139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:06.695046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f481f4a-2b90-471c-942a-baeab77be152 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:06.728830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:06.729682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:06.729980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:06.730289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:06.736817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:06.738254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:00:06.752291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:06.757383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:06.758499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 644/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 14:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:06.760148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:06.867465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a62ee-5fe0-478f-a040-5fc18301bc63 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:06.900345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:06.901042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:06.901318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:06.901592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:06.902364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:06.902669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:06.904099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c5546-21ab-440f-b680-1d0ff4a92b3d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:06.916546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 615/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 14:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:06.922802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:06.949733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:07.024668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20688b-79cb-4f3e-a05a-1b6be8db23c1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:07.057831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:07.058477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:07.058759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:07.059034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:07.059843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=6d5153b7c1af4b7285ada5dba9316416) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:07.060200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:07.061657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508c20e-4627-4767-9d23-d13562bb1091 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:07.066891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 645/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 14:00:06 2022] GET /identity/v3/role_assignments?user.id=6d5153b7c1af4b7285ada5dba9316416&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:09.307854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de37ef6-229f-4b8b-8c8b-906da8c018e1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:09.308487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de37ef6-229f-4b8b-8c8b-906da8c018e1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:09.308487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de37ef6-229f-4b8b-8c8b-906da8c018e1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:09.309783 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 616/1261] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:09.315329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:09.315752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:09.315894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:09.333279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:09.334801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:09.403031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 646/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:09.426521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de37ef6-229f-4b8b-8c8b-906da8c018e1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:09.437519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:09.527532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de37ef6-229f-4b8b-8c8b-906da8c018e1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:09.563034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:09.563880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:09.564153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:09.564425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:09.575205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:00:09.582937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:09.584609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:09.585768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 617/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 14:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:09.590980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:09.610641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:09.700247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd92c64-6753-43b5-82ad-8c085bd61553 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:09.738694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:09.739354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:09.739631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:09.739980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:09.741256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:09.741563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:09.742916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:09.751242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 647/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 14:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:09.757913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:09.829181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:09.862713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5666b2-aaa8-4d29-aad5-eca82df51597 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:09.898788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:09.899571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:09.899847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:09.900141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:09.910506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:09.912222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:09.929348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:09.930503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:09.931641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:09.931641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:09.931641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:09.931641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:09.931641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 618/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:09.936570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:10.027555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:10.045972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922b5e9-eec7-420c-9850-201c768475f6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:10.079165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:10.079875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:10.080106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:10.080382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:10.081132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:10.081446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:10.082806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:10.094393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 648/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:10.100536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:10.203945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62451ac0-f9b8-4874-bb51-d562e6fd4c59 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:10.223230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:10.239012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:10.240369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:10.240754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:10.241056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:10.248848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:10.250292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:00:10.265065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:10.266231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:10.267274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 619/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:00:10.272673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:10.376303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f906af-26da-495c-b3e9-feeeea49fff5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:10.412360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:10.413069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:10.413348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:10.413618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:10.414443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:10.414786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:10.416149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:10.425399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:10.434109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 649/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Wed May 18 14:00:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:10.439811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:10.546906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe78a7-4f17-48ef-877e-30838112ab73 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:10.595434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:10.596588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:10.597039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:10.597443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:10.609797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:10.611235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:10.629409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:10.630744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:10.631823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:10.631823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:10.631823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:10.631823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:10.631823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 620/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:10.636885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:10.742048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd02a7-6b09-42ca-88e4-a9505801220f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:10.776238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:10.776967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:10.777244 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:10.777513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:10.778221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:10.778523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:10.779968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:10.792382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 650/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:10.798537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:10.831373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:10.916020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73ae2e-a2f1-4de6-b8a9-9f33ae8ecb74 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:10.951349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:10.953573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:10.953573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:10.953573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:10.960160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:10.961709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:00:10.975973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:10.977116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:10.978239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 621/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 14:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:10.986429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:11.048359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:11.092588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1ace-25be-4c06-bb8d-62d6d6422409 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:11.127391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:11.128051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:11.128331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:11.128605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:11.129469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:11.129995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:11.131861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd72d02-03e2-488b-a137-f7b528849ca0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:11.145260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 651/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 14:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:11.152046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:11.249930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:11.259230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93d67-28b3-490a-bc06-30283d462e39 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:11.294636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf4e41-1161-477e-8ef7-8810e2cc5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:11.295570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf4e41-1161-477e-8ef7-8810e2cc5dbd None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:11.295806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf4e41-1161-477e-8ef7-8810e2cc5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:11.296079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf4e41-1161-477e-8ef7-8810e2cc5dbd None admin] PATH_INFO: `/v3/projects/3338208b8c184f118998b6d48d699410/users/6d5153b7c1af4b7285ada5dba9316416/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:11.298056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf4e41-1161-477e-8ef7-8810e2cc5dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=3338208b8c184f118998b6d48d699410, user_id=6d5153b7c1af4b7285ada5dba9316416, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:11.299845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf4e41-1161-477e-8ef7-8810e2cc5dbd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:11.422160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 622/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Wed May 18 14:00:11 2022] PUT /identity/v3/projects/3338208b8c184f118998b6d48d699410/users/6d5153b7c1af4b7285ada5dba9316416/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:00:13.686024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb809-bc9d-4d05-83c2-792b1d405a51 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:13.686592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb809-bc9d-4d05-83c2-792b1d405a51 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:13.686592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fb809-bc9d-4d05-83c2-792b1d405a51 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:13.688003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 652/1274] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:13.695019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:13.695552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:13.695955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:13.719301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:13.720535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:13.792981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 623/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:13.817236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fb809-bc9d-4d05-83c2-792b1d405a51 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:13.935595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fb809-bc9d-4d05-83c2-792b1d405a51 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:13.960958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:13.981535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:13.982706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:13.983119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:13.983523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:14.006269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 14:00:14.013992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:14.014996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:14.015960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 653/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Wed May 18 14:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:14.022329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:14.108816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:14.126667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634356a-692d-4182-b825-b6e6d9f21b69 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:14.162785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:14.163462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:14.163743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:14.164016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:14.164754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:14.165089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:14.166461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:14.174814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 624/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Wed May 18 14:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:14.180875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:14.300133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8775094-4775-4af9-aa4f-0650b58b1eba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:14.339063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:14.339851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:14.340132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:14.340409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:14.351442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:14.352957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:14.370463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:14.371681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:14.372818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:14.372818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:14.372818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:14.372818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:14.372818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 654/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 14:00:14.377675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:14.483802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724aaf1-7987-4f7d-944e-e4dda2906a7a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:14.520710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:14.521917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:14.522221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:14.522489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:14.523214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:14.523516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:14.524955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:14.537444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 625/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:14.543146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:14.574970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:14.653984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b32013-9fdf-4470-9f50-546f9d13906d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:14.689564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:14.690350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:14.690628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:14.690946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:14.700384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:14.701883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 14:00:14.717444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:14.725860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:14.727260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 655/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:14.728118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:14.729358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:14.828919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e3db-4256-4f7d-857f-c4efb27dec98 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:14.864038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:14.865265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:14.865583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:14.865860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:14.866785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:14.867087 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:14.868515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:14.889681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 626/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Wed May 18 14:00:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:14.895832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:14.989516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:14.999641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f64fbd-e8d7-4c49-8d04-e10d559f5334 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:15.040129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:15.040817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:15.041101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:15.041377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:15.111354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:15.112719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:15.204589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:15.214936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 656/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Wed May 18 14:00:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 14:00:15.220829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:15.287426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:15.332538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb94e0-bfdb-4d1d-b14c-d09e2b5f4ae6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:15.367324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:15.368028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:15.368310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:15.368632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:15.379369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:15.380904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 14:00:15.399046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:15.400190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:15.401221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 14:00:15.401221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 14:00:15.401221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 14:00:15.401221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:15.401221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 627/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:15.406109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:15.508655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407c9bd-d34f-4373-9bee-2f5116d02eee None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:15.545174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:15.545972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:15.546258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:15.546537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:15.547257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:15.547568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:15.548960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:15.561117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 657/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Wed May 18 14:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:15.566855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:15.693136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb5c67-086a-412a-a04e-59e572fac5fc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:15.711690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:15.731981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:15.734416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:15.734416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:15.734416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:15.741861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:15.742524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 14:00:15.758309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:15.759539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: ERROR keystone.server.flask.application May 18 14:00:15.760656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 628/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Wed May 18 14:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:15.766298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:15.820820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:15.880874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211377c1-ebe6-4cf2-9e3c-0fd2235fbe8f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:15.929925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:15.930589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:15.930872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:15.931146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:15.931937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:15.932240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:15.933684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70aff3-1326-4e97-9422-8caf45d9ffb1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:15.947493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 658/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Wed May 18 14:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:15.954450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:16.058828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f67bc9-1191-46f0-a8dc-ab8ad3dbf930 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:16.094052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:16.100021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:16.100021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:16.100021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:16.100021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] RBAC: Adding query filter params (role.id=264bc025e3d84d9ebb870cc70b4a213a, scope.project.id=3338208b8c184f118998b6d48d699410, user.id=6d5153b7c1af4b7285ada5dba9316416) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:16.100021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:16.100021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8594698-070c-4a3f-98c4-f30139593924 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:16.104100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 629/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Wed May 18 14:00:15 2022] GET /identity/v3/role_assignments?user.id=6d5153b7c1af4b7285ada5dba9316416&scope.project.id=3338208b8c184f118998b6d48d699410&role.id=264bc025e3d84d9ebb870cc70b4a213a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:18.402998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eae078-3044-4e62-920f-34f63991b77d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:18.403523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eae078-3044-4e62-920f-34f63991b77d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:18.403523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eae078-3044-4e62-920f-34f63991b77d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:18.405144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 659/1288] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:18.410309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:18.410759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:18.410850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:18.428257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:18.429501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:18.459206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:18.496378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 630/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:18.518761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eae078-3044-4e62-920f-34f63991b77d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:18.626019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eae078-3044-4e62-920f-34f63991b77d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:18.637560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:18.662197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:18.663110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:18.663394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:18.663671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:18.664319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:18.665714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:18.677523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:18.678776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:18.679909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 660/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 14:00:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:18.685436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:18.794473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb6a06-248d-464e-a207-0b654d7f5b77 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:18.833968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:18.835153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:18.835429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:18.835697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:18.836394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:18.836702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:18.838084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9b055-590b-4e46-9a24-1d4c2aded159 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:18.843049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 631/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Wed May 18 14:00:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:18.848880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:18.955583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54460973-99ba-4939-872b-14b372dbcf85 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:18.990526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:18.991186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:18.991467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:18.991742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:18.992444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:18.992747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:18.994159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872c9f-42e8-4c57-a5f6-187621f2be99 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:19.001190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 661/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Wed May 18 14:00:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:21.259012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce54a-1d23-43cd-9500-2a66ccf87be1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:21.259601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce54a-1d23-43cd-9500-2a66ccf87be1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:21.259601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce54a-1d23-43cd-9500-2a66ccf87be1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:21.261025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 632/1293] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:21.267899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108e40f-b335-4beb-9a67-1f840e8d7a6c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:21.268455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108e40f-b335-4beb-9a67-1f840e8d7a6c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:21.268579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108e40f-b335-4beb-9a67-1f840e8d7a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:21.290547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5108e40f-b335-4beb-9a67-1f840e8d7a6c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:21.291776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5108e40f-b335-4beb-9a67-1f840e8d7a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:21.339345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:21.391596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 662/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:21.420001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce54a-1d23-43cd-9500-2a66ccf87be1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:21.461832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:21.549740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce54a-1d23-43cd-9500-2a66ccf87be1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:21.591954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67373c1-530e-4b6d-baec-eeca87f62bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:21.592622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67373c1-530e-4b6d-baec-eeca87f62bef None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:21.592946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67373c1-530e-4b6d-baec-eeca87f62bef None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:21.593221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67373c1-530e-4b6d-baec-eeca87f62bef None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:21.594126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67373c1-530e-4b6d-baec-eeca87f62bef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:21.595720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67373c1-530e-4b6d-baec-eeca87f62bef None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:21.667847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 633/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Wed May 18 14:00:21 2022] POST /identity/v3/services => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:00:24.068013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f8c6-f0aa-4903-973a-7d82e9e038a3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:24.068852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f8c6-f0aa-4903-973a-7d82e9e038a3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:24.068852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208f8c6-f0aa-4903-973a-7d82e9e038a3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:24.070058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 663/1296] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:24.075816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:24.076928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:24.076928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:24.095367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:24.096574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:24.176798 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 634/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:24.200279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208f8c6-f0aa-4903-973a-7d82e9e038a3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:24.328282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208f8c6-f0aa-4903-973a-7d82e9e038a3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:24.367801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:24.368641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:24.368965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:24.369254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:24.369910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:24.371293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:24.384175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:24.390557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:24.391982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 664/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 14:00:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:24.393073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:24.411869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:24.505035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fddee0-a0df-4f94-945b-873dd5b5dd84 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:24.543430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:24.544095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:24.544376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:24.544651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:24.545385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:24.545687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:24.547067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:24.553455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 635/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Wed May 18 14:00:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:00:24.559939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:24.596998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:24.669486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad17b0-7b92-421a-b156-3de8e607707a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:24.706925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:24.707617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:24.707898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:24.708225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:24.709092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] RBAC: Adding query filter params (interface=public, service_id=1ddbee1a0c674bfbb301a789d55e0369, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:24.709416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:24.710794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5c226-5a59-42d6-af88-64b5021b13c9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:24.716602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 665/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Wed May 18 14:00:24 2022] GET /identity/v3/endpoints?service_id=1ddbee1a0c674bfbb301a789d55e0369&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:24.722925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:24.815409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:24.837530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dfefd-e089-4d2c-9ce4-228ced2d5645 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:24.877704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f93259-01d4-479f-9f1b-e2b8b1b9c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:24.878290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f93259-01d4-479f-9f1b-e2b8b1b9c234 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:24.878574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f93259-01d4-479f-9f1b-e2b8b1b9c234 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:24.878849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f93259-01d4-479f-9f1b-e2b8b1b9c234 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:24.879543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f93259-01d4-479f-9f1b-e2b8b1b9c234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:24.880991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f93259-01d4-479f-9f1b-e2b8b1b9c234 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:24.888820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 636/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Wed May 18 14:00:24 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:00:27.179553 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6bd1-5049-45ab-9dfb-afb02af83c56 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:27.180120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6bd1-5049-45ab-9dfb-afb02af83c56 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:27.180120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6bd1-5049-45ab-9dfb-afb02af83c56 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:27.181516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 666/1302] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:00:27.186846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:27.187289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:27.187390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:27.204311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:00:27.205540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:00:27.278630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 637/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:00:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 14:00:27.301625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d6bd1-5049-45ab-9dfb-afb02af83c56 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:27.408044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:27.415116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d6bd1-5049-45ab-9dfb-afb02af83c56 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:27.453858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:27.454727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:27.455222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:27.455664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:27.456643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:27.458078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 14:00:27.470170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 14:00:27.471532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: ERROR keystone.server.flask.application May 18 14:00:27.472482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 667/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Wed May 18 14:00:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 14:00:27.478037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:27.556318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:27.578960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09491-e78b-4bf3-ba2f-f71ac47eb206 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:27.613098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:27.613768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:27.614048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:27.614958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:27.615710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:00:27.616026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:27.617411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31085bae-adef-4ab0-961c-38fdc0dc7de4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:27.622630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 638/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Wed May 18 14:00:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:00:27.628657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:00:27.731602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ff5b-5dcf-4ce2-a59d-757e7952b0f8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:00:27.767929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871edc44-314f-48cc-8276-c9316b9fed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:00:27.768655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871edc44-314f-48cc-8276-c9316b9fed58 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:00:27.768966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871edc44-314f-48cc-8276-c9316b9fed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:00:27.769497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871edc44-314f-48cc-8276-c9316b9fed58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:00:27.770258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871edc44-314f-48cc-8276-c9316b9fed58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:00:27.772114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871edc44-314f-48cc-8276-c9316b9fed58 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:00:27.873610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 668/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Wed May 18 14:00:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:00:37.619591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=30 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:00:37.868656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:04.130790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996dc81-f732-43b7-9e64-dc08e0afb02c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:04.131367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996dc81-f732-43b7-9e64-dc08e0afb02c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:04.131464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996dc81-f732-43b7-9e64-dc08e0afb02c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:04.133102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 639/1307] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:04.138663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436d83-4467-4046-bbf3-1bae204e828c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:04.139158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436d83-4467-4046-bbf3-1bae204e828c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:04.139255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01436d83-4467-4046-bbf3-1bae204e828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:04.624453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-01436d83-4467-4046-bbf3-1bae204e828c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:04.624453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-01436d83-4467-4046-bbf3-1bae204e828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:04.624453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 669/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:04.625889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd517-a16e-4a45-b9c2-7fb16b55e3d7 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:04.625889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd517-a16e-4a45-b9c2-7fb16b55e3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:04.625889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd517-a16e-4a45-b9c2-7fb16b55e3d7 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:04.625889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 640/1309] 10.222.0.71 () {54 vars in 964 bytes} [Wed May 18 14:08:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:04.627160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d603b-ca68-44d4-afba-cd82d456c15e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:04.627160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d603b-ca68-44d4-afba-cd82d456c15e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:04.627160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d603b-ca68-44d4-afba-cd82d456c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:04.696389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5b2d603b-ca68-44d4-afba-cd82d456c15e None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:04.697615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5b2d603b-ca68-44d4-afba-cd82d456c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:04.721914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:04.820450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 670/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Wed May 18 14:08:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:04.830555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd517-a16e-4a45-b9c2-7fb16b55e3d7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:04.832630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-529dd517-a16e-4a45-b9c2-7fb16b55e3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:04.970175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd517-a16e-4a45-b9c2-7fb16b55e3d7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:05.059958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:05.060613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:05.060927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:05.061193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:05.063193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:05.138036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:05.214108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:05.215642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d3f86-dc29-47a8-9178-694b04e4aaab service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:05.237870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 641/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:08:08.022166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d351b-5ba9-4413-aec1-4e3770534eae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:08.022691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d351b-5ba9-4413-aec1-4e3770534eae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:08.022691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d351b-5ba9-4413-aec1-4e3770534eae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:08.024112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 671/1312] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:08.030230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c4df0-57bd-41be-b584-29fd01779f3a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:08.031043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c4df0-57bd-41be-b584-29fd01779f3a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:08.031043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c4df0-57bd-41be-b584-29fd01779f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:08.110122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-512c4df0-57bd-41be-b584-29fd01779f3a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:08.111336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-512c4df0-57bd-41be-b584-29fd01779f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:08.236393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 642/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:08:08.267348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d351b-5ba9-4413-aec1-4e3770534eae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:08.269387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-799d351b-5ba9-4413-aec1-4e3770534eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:08.393183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d351b-5ba9-4413-aec1-4e3770534eae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:08.498783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:08.501901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:08.502603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:08.502879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:08.503149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:08.505576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:08.631668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:08.633049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1e190-a19e-4064-8023-910f6742c221 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:08.655679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 672/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:11.462585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c3322-5223-4de5-beda-ae273e7ea7df None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:11.463510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c3322-5223-4de5-beda-ae273e7ea7df None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:11.463510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c3322-5223-4de5-beda-ae273e7ea7df None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:11.465055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 643/1315] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:11.470289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d21fc-7781-46a0-83c0-780ce34bf711 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:11.470768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d21fc-7781-46a0-83c0-780ce34bf711 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:11.470876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d21fc-7781-46a0-83c0-780ce34bf711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:11.534906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-304d21fc-7781-46a0-83c0-780ce34bf711 None None] MFA Rules not processed for user `5ddcc524dfeb40e8a8372a7177400fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:11.536584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-304d21fc-7781-46a0-83c0-780ce34bf711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:11.592185 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:11.645201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 673/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:11.685369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c3322-5223-4de5-beda-ae273e7ea7df None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:11.687123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d25c3322-5223-4de5-beda-ae273e7ea7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:11.697655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:11.794235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c3322-5223-4de5-beda-ae273e7ea7df None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:11.869356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:11.870018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:11.870302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:11.870577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:11.872350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:11.943555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:11.992334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:11.993830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905dcd-7533-417c-ac94-e68195b65a69 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:12.012600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 644/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:15.110206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7d795-d9d7-4769-8d24-99a6a5828012 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:15.110872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7d795-d9d7-4769-8d24-99a6a5828012 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:15.110872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7d795-d9d7-4769-8d24-99a6a5828012 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:15.112263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 674/1318] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:15.119450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d076-16cd-49ad-8486-e6000e442c43 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:15.119980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d076-16cd-49ad-8486-e6000e442c43 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:15.119980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717d076-16cd-49ad-8486-e6000e442c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:15.193304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f717d076-16cd-49ad-8486-e6000e442c43 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:15.195200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f717d076-16cd-49ad-8486-e6000e442c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:15.318082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 645/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:15.357055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7d795-d9d7-4769-8d24-99a6a5828012 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:15.358571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-45c7d795-d9d7-4769-8d24-99a6a5828012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:15.462168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7d795-d9d7-4769-8d24-99a6a5828012 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:15.539290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:15.539927 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:15.540206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:15.540473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:15.542131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:15.549800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:15.660084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:15.661806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3dc3-f5f9-47b3-987e-fa065590698b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:15.684729 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 675/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:18.985350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff906-5921-43b6-b73a-6733351ed503 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:18.985958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff906-5921-43b6-b73a-6733351ed503 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:18.985958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff906-5921-43b6-b73a-6733351ed503 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:18.987297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 646/1321] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:18.992919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee363f93-f43c-4c22-b1b8-2ed7c651a936 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:18.993443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee363f93-f43c-4c22-b1b8-2ed7c651a936 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:18.993579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee363f93-f43c-4c22-b1b8-2ed7c651a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:19.060529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ee363f93-f43c-4c22-b1b8-2ed7c651a936 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:19.061786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ee363f93-f43c-4c22-b1b8-2ed7c651a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:19.119155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:19.159791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 676/1322] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:19.197117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afff906-5921-43b6-b73a-6733351ed503 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:19.198739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6afff906-5921-43b6-b73a-6733351ed503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:19.219244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:19.318375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afff906-5921-43b6-b73a-6733351ed503 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:19.398651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:19.399296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:19.399573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:19.399845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:19.401559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:19.480712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:19.520079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:19.522067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5e33-ad41-4582-aa2d-e823b5b985dd service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:19.541248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 647/1323] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:21.887038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72f47-8334-4457-bc54-ddd203be9f78 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:21.887581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72f47-8334-4457-bc54-ddd203be9f78 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:21.887581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72f47-8334-4457-bc54-ddd203be9f78 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:21.889010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 677/1324] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:21.895746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb08c-8ad7-4dc1-8751-fe7296d3c7c4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:21.896613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb08c-8ad7-4dc1-8751-fe7296d3c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:21.896724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feb08c-8ad7-4dc1-8751-fe7296d3c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:21.982151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-88feb08c-8ad7-4dc1-8751-fe7296d3c7c4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:21.983399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-88feb08c-8ad7-4dc1-8751-fe7296d3c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:22.108624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 648/1325] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:22.163407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ba5a-0ee4-4f8f-a43f-6187cd45a820 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:22.164343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ba5a-0ee4-4f8f-a43f-6187cd45a820 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:22.164699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ba5a-0ee4-4f8f-a43f-6187cd45a820 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:22.166495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 678/1326] 10.222.0.71 () {54 vars in 964 bytes} [Wed May 18 14:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:22.173451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006032-5a06-4fbf-b194-a756078aee2c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:22.173816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006032-5a06-4fbf-b194-a756078aee2c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:22.174229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75006032-5a06-4fbf-b194-a756078aee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:22.210185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:22.270456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-75006032-5a06-4fbf-b194-a756078aee2c None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:22.271784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-75006032-5a06-4fbf-b194-a756078aee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:22.357691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 649/1327] 10.222.0.71 () {58 vars in 1061 bytes} [Wed May 18 14:08:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:22.366857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412ba5a-0ee4-4f8f-a43f-6187cd45a820 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:22.368657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d412ba5a-0ee4-4f8f-a43f-6187cd45a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:22.486842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412ba5a-0ee4-4f8f-a43f-6187cd45a820 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:22.578131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:22.578790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:22.579069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:22.579386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:22.581091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:22.601941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:22.705269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:22.706703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab8ec5-2ab6-4e1d-9955-3960cb83702d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:22.727295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 679/1328] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:25.885972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836615c-5b68-4dc9-8693-46741ce5bd25 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:25.886819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836615c-5b68-4dc9-8693-46741ce5bd25 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:25.886819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836615c-5b68-4dc9-8693-46741ce5bd25 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:25.888272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 650/1329] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:25.897038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd783-8bb1-4fe7-949a-813ea888c686 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:25.897621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd783-8bb1-4fe7-949a-813ea888c686 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:25.898248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfd783-8bb1-4fe7-949a-813ea888c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:25.980940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-89dfd783-8bb1-4fe7-949a-813ea888c686 None None] MFA Rules not processed for user `5ddcc524dfeb40e8a8372a7177400fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:25.982250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-89dfd783-8bb1-4fe7-949a-813ea888c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:26.061661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:26.102104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 680/1330] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:26.145601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836615c-5b68-4dc9-8693-46741ce5bd25 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:26.147343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e836615c-5b68-4dc9-8693-46741ce5bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:26.317851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836615c-5b68-4dc9-8693-46741ce5bd25 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:26.358028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:26.450372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:26.451150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:26.451611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:26.451975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:26.453904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:26.603642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:26.606674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8d143-b452-4e8b-9d04-1640a67011fd service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:26.642689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 651/1331] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:08:29.730422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde805c-4daf-45b6-84d6-789db90437a5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:29.731018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde805c-4daf-45b6-84d6-789db90437a5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:29.731397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde805c-4daf-45b6-84d6-789db90437a5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:29.733985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 681/1332] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:29.743526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe49706-3450-4c73-86e1-fab483ff14e1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:29.744330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe49706-3450-4c73-86e1-fab483ff14e1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:29.744604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe49706-3450-4c73-86e1-fab483ff14e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:29.845984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:29.850062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8fe49706-3450-4c73-86e1-fab483ff14e1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:29.851678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8fe49706-3450-4c73-86e1-fab483ff14e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:30.011765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 652/1333] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:30.055811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde805c-4daf-45b6-84d6-789db90437a5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:30.057590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5bde805c-4daf-45b6-84d6-789db90437a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:30.252257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde805c-4daf-45b6-84d6-789db90437a5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:30.357237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:30.357744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:30.358022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:30.358298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:30.359970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:30.397080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:30.568994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:30.570492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c1ab2-a955-4703-9135-6f1510f2c436 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:30.595182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 682/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:33.487117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe72b-41c9-4643-97e2-6d615ced95f1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:33.487735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe72b-41c9-4643-97e2-6d615ced95f1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:33.487735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbe72b-41c9-4643-97e2-6d615ced95f1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:33.489144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 653/1335] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:33.494973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c254305-b31a-45f1-aec8-b92066212d63 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:33.495666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c254305-b31a-45f1-aec8-b92066212d63 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:33.495666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c254305-b31a-45f1-aec8-b92066212d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:33.563270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c254305-b31a-45f1-aec8-b92066212d63 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:33.564491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c254305-b31a-45f1-aec8-b92066212d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:33.644917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:33.667442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 683/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:33.707854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe72b-41c9-4643-97e2-6d615ced95f1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:33.709771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c5fbe72b-41c9-4643-97e2-6d615ced95f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:33.818262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbe72b-41c9-4643-97e2-6d615ced95f1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:33.857704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:33.917335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:33.917984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:33.918445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:33.918718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:33.920369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:34.044301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:34.045790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1e44a-7fc3-4238-868a-e217ca04eb8f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:34.065404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 654/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:37.490668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00139-629b-4942-ba50-8f1397b2bf3b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:37.491220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00139-629b-4942-ba50-8f1397b2bf3b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:37.491220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00139-629b-4942-ba50-8f1397b2bf3b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:37.492595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 684/1338] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:37.498447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100dae-0a98-48bd-b2e5-c920a3980c85 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:37.498904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100dae-0a98-48bd-b2e5-c920a3980c85 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:37.499000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100dae-0a98-48bd-b2e5-c920a3980c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:37.571274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5b100dae-0a98-48bd-b2e5-c920a3980c85 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:37.572503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5b100dae-0a98-48bd-b2e5-c920a3980c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:37.581656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:37.686459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 655/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:08:37.723842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b00139-629b-4942-ba50-8f1397b2bf3b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:37.726322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18b00139-629b-4942-ba50-8f1397b2bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:37.829166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b00139-629b-4942-ba50-8f1397b2bf3b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:37.833074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9d253-65a7-4a27-8228-356eec83a62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:37.833721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9d253-65a7-4a27-8228-356eec83a62e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:37.833998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9d253-65a7-4a27-8228-356eec83a62e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:37.834273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9d253-65a7-4a27-8228-356eec83a62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:37.843175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9d253-65a7-4a27-8228-356eec83a62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:37.844585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9d253-65a7-4a27-8228-356eec83a62e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:37.854680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 685/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:08:42.519795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d163d-606e-409f-8413-d8c1d0c622cc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:42.520391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d163d-606e-409f-8413-d8c1d0c622cc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:42.520497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d163d-606e-409f-8413-d8c1d0c622cc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:42.522548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 656/1341] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:42.528805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c215217-1658-41f8-b4c1-2db3224aa723 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:42.530065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c215217-1658-41f8-b4c1-2db3224aa723 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:42.530503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c215217-1658-41f8-b4c1-2db3224aa723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:42.569412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c215217-1658-41f8-b4c1-2db3224aa723 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:42.571816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c215217-1658-41f8-b4c1-2db3224aa723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:42.667963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 686/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:08:42.707958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d163d-606e-409f-8413-d8c1d0c622cc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:42.719486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d163d-606e-409f-8413-d8c1d0c622cc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:42.723919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f8d35-2ed9-4e3d-aacc-e309e73b1f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:42.724596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8d35-2ed9-4e3d-aacc-e309e73b1f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:42.724956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8d35-2ed9-4e3d-aacc-e309e73b1f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:42.725181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f8d35-2ed9-4e3d-aacc-e309e73b1f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:42.734951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f8d35-2ed9-4e3d-aacc-e309e73b1f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:42.736392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f8d35-2ed9-4e3d-aacc-e309e73b1f9b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:42.747183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 657/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:46.251416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b361-01d4-4244-90b6-a6442a0e385c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:46.251952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b361-01d4-4244-90b6-a6442a0e385c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:46.251952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30b361-01d4-4244-90b6-a6442a0e385c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:46.253423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 687/1344] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:46.258713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bee0e-57fd-4238-b60e-c54e21f2a0c0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:46.259164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bee0e-57fd-4238-b60e-c54e21f2a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:46.259334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bee0e-57fd-4238-b60e-c54e21f2a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:46.278647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fe7bee0e-57fd-4238-b60e-c54e21f2a0c0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:46.279856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fe7bee0e-57fd-4238-b60e-c54e21f2a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:46.289192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 658/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:08:46.328077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b361-01d4-4244-90b6-a6442a0e385c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:46.339740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30b361-01d4-4244-90b6-a6442a0e385c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:46.343277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d2bb3-11ea-434c-91c1-8b29dad9087d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:46.343923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d2bb3-11ea-434c-91c1-8b29dad9087d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:46.344206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d2bb3-11ea-434c-91c1-8b29dad9087d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:46.344477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d2bb3-11ea-434c-91c1-8b29dad9087d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:46.356560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d2bb3-11ea-434c-91c1-8b29dad9087d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:46.358936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d2bb3-11ea-434c-91c1-8b29dad9087d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:46.369256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 688/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:50.988545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f63e8-4387-4fe3-8d38-546568df799b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:50.989189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f63e8-4387-4fe3-8d38-546568df799b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:50.989189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f63e8-4387-4fe3-8d38-546568df799b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:50.990595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 659/1347] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:50.996521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b56f8-2f09-4366-851f-434f95035bf8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:50.997095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b56f8-2f09-4366-851f-434f95035bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:50.997095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b56f8-2f09-4366-851f-434f95035bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:51.017441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3a1b56f8-2f09-4366-851f-434f95035bf8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:51.019225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3a1b56f8-2f09-4366-851f-434f95035bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:51.028201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 689/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:08:51.066674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f63e8-4387-4fe3-8d38-546568df799b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:08:51.078053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f63e8-4387-4fe3-8d38-546568df799b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:08:51.082302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1938b8c-8c99-4f21-a150-d7b4bf0407a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:08:51.083021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1938b8c-8c99-4f21-a150-d7b4bf0407a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:51.083375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1938b8c-8c99-4f21-a150-d7b4bf0407a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:51.083726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1938b8c-8c99-4f21-a150-d7b4bf0407a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:51.093421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1938b8c-8c99-4f21-a150-d7b4bf0407a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:08:51.095229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1938b8c-8c99-4f21-a150-d7b4bf0407a3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:08:51.106461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 660/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:08:56.822171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adae80-ca5f-4add-b2d7-7af289df31ee None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:56.823159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adae80-ca5f-4add-b2d7-7af289df31ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:56.823622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adae80-ca5f-4add-b2d7-7af289df31ee None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:56.825518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 690/1350] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:08:56.831387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db841ef-bea9-42e2-a4b5-70ac87250359 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:08:56.831865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db841ef-bea9-42e2-a4b5-70ac87250359 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:08:56.831948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db841ef-bea9-42e2-a4b5-70ac87250359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:08:56.929924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3db841ef-bea9-42e2-a4b5-70ac87250359 None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:08:56.931413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3db841ef-bea9-42e2-a4b5-70ac87250359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:08:56.996221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:08:57.050434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 661/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:08:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:01.011891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:09:01.768917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534f08-304e-46a3-ac6c-a504114909cf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:01.769349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534f08-304e-46a3-ac6c-a504114909cf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:01.769472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534f08-304e-46a3-ac6c-a504114909cf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:01.771279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 691/1352] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:01.776443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922555b-c344-444f-81ec-7dc4bfb7c55d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:01.777366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922555b-c344-444f-81ec-7dc4bfb7c55d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:01.777959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922555b-c344-444f-81ec-7dc4bfb7c55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:01.803024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4922555b-c344-444f-81ec-7dc4bfb7c55d None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:01.806106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4922555b-c344-444f-81ec-7dc4bfb7c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:01.818628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 662/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:09:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:03.208386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71fb7-c094-43be-b034-8cbf46217879 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:03.208959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71fb7-c094-43be-b034-8cbf46217879 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:03.209229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71fb7-c094-43be-b034-8cbf46217879 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:03.210921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 692/1354] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:03.217327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536032f1-5dfa-4e2a-9265-69ad03ee219c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:03.217877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536032f1-5dfa-4e2a-9265-69ad03ee219c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:03.217877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536032f1-5dfa-4e2a-9265-69ad03ee219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:03.240594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-536032f1-5dfa-4e2a-9265-69ad03ee219c None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:03.241902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-536032f1-5dfa-4e2a-9265-69ad03ee219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:03.250976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 663/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:09:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:07.408619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44209d90-5c98-41bf-88e4-76558e9fb83a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:07.409933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44209d90-5c98-41bf-88e4-76558e9fb83a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:07.410401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44209d90-5c98-41bf-88e4-76558e9fb83a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:07.412533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 693/1356] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:07.418886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf66e7-d9cb-4669-91ca-c41b99ef8751 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:07.418886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf66e7-d9cb-4669-91ca-c41b99ef8751 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:07.418886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf66e7-d9cb-4669-91ca-c41b99ef8751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:07.439559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7fbf66e7-d9cb-4669-91ca-c41b99ef8751 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:07.442545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7fbf66e7-d9cb-4669-91ca-c41b99ef8751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:07.452762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 664/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:07.523203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7dcde-20dd-41ba-97fe-07a5b20b9f48 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:07.524882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7dcde-20dd-41ba-97fe-07a5b20b9f48 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:07.527801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7dcde-20dd-41ba-97fe-07a5b20b9f48 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:07.527801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 694/1358] 10.222.0.71 () {54 vars in 961 bytes} [Wed May 18 14:09:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:07.537784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0decbe-6b0c-4f5e-b15f-55f872b00305 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:07.538598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0decbe-6b0c-4f5e-b15f-55f872b00305 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:07.539166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0decbe-6b0c-4f5e-b15f-55f872b00305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:07.602758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-da0decbe-6b0c-4f5e-b15f-55f872b00305 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:07.603624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-da0decbe-6b0c-4f5e-b15f-55f872b00305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:07.706750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 665/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Wed May 18 14:09:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:07.716587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7dcde-20dd-41ba-97fe-07a5b20b9f48 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:07.732510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7dcde-20dd-41ba-97fe-07a5b20b9f48 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:07.738620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64b893-8f29-4b8c-8324-40fe7cbbb2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:07.739256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64b893-8f29-4b8c-8324-40fe7cbbb2b4 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:07.739716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64b893-8f29-4b8c-8324-40fe7cbbb2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:07.739998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64b893-8f29-4b8c-8324-40fe7cbbb2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:07.753158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64b893-8f29-4b8c-8324-40fe7cbbb2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:07.755174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64b893-8f29-4b8c-8324-40fe7cbbb2b4 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:07.769176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 695/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:10.444253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226029b5-3e77-4ce3-bb75-6ffe831ce65f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:10.444878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226029b5-3e77-4ce3-bb75-6ffe831ce65f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:10.444878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226029b5-3e77-4ce3-bb75-6ffe831ce65f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:10.446403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 666/1361] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:10.451943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9aa9e-4ac5-4c03-a2b5-a1a4e89cd443 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:10.452779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9aa9e-4ac5-4c03-a2b5-a1a4e89cd443 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:10.453089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9aa9e-4ac5-4c03-a2b5-a1a4e89cd443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:10.473428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-02c9aa9e-4ac5-4c03-a2b5-a1a4e89cd443 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:10.474695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-02c9aa9e-4ac5-4c03-a2b5-a1a4e89cd443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:10.484287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 696/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:10.529903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226029b5-3e77-4ce3-bb75-6ffe831ce65f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:10.546686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226029b5-3e77-4ce3-bb75-6ffe831ce65f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:10.552483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834ac05-e1d6-4e45-9595-5ab0c6fba0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:10.553173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ac05-e1d6-4e45-9595-5ab0c6fba0f2 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:10.553462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ac05-e1d6-4e45-9595-5ab0c6fba0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:10.553895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ac05-e1d6-4e45-9595-5ab0c6fba0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:10.571845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834ac05-e1d6-4e45-9595-5ab0c6fba0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:10.573642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834ac05-e1d6-4e45-9595-5ab0c6fba0f2 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:10.586034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 667/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:09:13.444736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769138-1038-40b8-8d26-6406d0801ea5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:13.445535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769138-1038-40b8-8d26-6406d0801ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:13.445535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66769138-1038-40b8-8d26-6406d0801ea5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:13.446817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 697/1364] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:13.459375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918da08-2881-467c-8f08-4867faf8ddaa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:13.460275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918da08-2881-467c-8f08-4867faf8ddaa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:13.460551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918da08-2881-467c-8f08-4867faf8ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:13.483296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7918da08-2881-467c-8f08-4867faf8ddaa None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:13.484584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7918da08-2881-467c-8f08-4867faf8ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:13.500943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 668/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:09:13.547403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4089b-335c-4d14-a3ac-551338d3c469 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:13.547933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4089b-335c-4d14-a3ac-551338d3c469 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:13.548942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4089b-335c-4d14-a3ac-551338d3c469 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:13.550901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 698/1366] 10.222.0.71 () {54 vars in 961 bytes} [Wed May 18 14:09:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:13.557078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236e58-6290-43da-b6fc-5c985669e8d2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:13.558626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236e58-6290-43da-b6fc-5c985669e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:13.558626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236e58-6290-43da-b6fc-5c985669e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:13.582543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-64236e58-6290-43da-b6fc-5c985669e8d2 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:13.584053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64236e58-6290-43da-b6fc-5c985669e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:13.593952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 669/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Wed May 18 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:13.603888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4089b-335c-4d14-a3ac-551338d3c469 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:13.618962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4089b-335c-4d14-a3ac-551338d3c469 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:13.624779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2d24d-b61c-414a-94d5-8db5cf583657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:13.625462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d24d-b61c-414a-94d5-8db5cf583657 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:13.625750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d24d-b61c-414a-94d5-8db5cf583657 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:13.626024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2d24d-b61c-414a-94d5-8db5cf583657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:13.635311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d24d-b61c-414a-94d5-8db5cf583657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:13.636934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2d24d-b61c-414a-94d5-8db5cf583657 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:13.648464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 699/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:16.261415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c834-7611-4975-9a7d-ccea84c4b465 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.262665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c834-7611-4975-9a7d-ccea84c4b465 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.263265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c834-7611-4975-9a7d-ccea84c4b465 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.266197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 670/1369] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:16.272538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772739bc-eef9-4a07-b87f-5c7600de69a4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.273152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772739bc-eef9-4a07-b87f-5c7600de69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.273152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772739bc-eef9-4a07-b87f-5c7600de69a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.293925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-772739bc-eef9-4a07-b87f-5c7600de69a4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:16.295183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-772739bc-eef9-4a07-b87f-5c7600de69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:16.308195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 700/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:16.363067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c834-7611-4975-9a7d-ccea84c4b465 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:16.398307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c834-7611-4975-9a7d-ccea84c4b465 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:16.405465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7807e-a1ba-4b34-bcbb-e6707d15203a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:16.406702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7807e-a1ba-4b34-bcbb-e6707d15203a service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.407374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7807e-a1ba-4b34-bcbb-e6707d15203a service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.409139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7807e-a1ba-4b34-bcbb-e6707d15203a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.422019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7807e-a1ba-4b34-bcbb-e6707d15203a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:16.425546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7807e-a1ba-4b34-bcbb-e6707d15203a service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:16.443056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 671/1371] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:16.476132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563fc5-b1e1-44ff-b375-21df68e94b65 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.476733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563fc5-b1e1-44ff-b375-21df68e94b65 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.477300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563fc5-b1e1-44ff-b375-21df68e94b65 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.479659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 701/1372] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:16.485989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae461a-38c8-4def-91f0-b003728dd485 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.486394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae461a-38c8-4def-91f0-b003728dd485 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.486774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae461a-38c8-4def-91f0-b003728dd485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.506608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bbae461a-38c8-4def-91f0-b003728dd485 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:16.507889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bbae461a-38c8-4def-91f0-b003728dd485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:16.516548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 672/1373] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:16.836804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d88f-3e13-4999-8ff0-b9259bd9c5a5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.837132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d88f-3e13-4999-8ff0-b9259bd9c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.837293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d88f-3e13-4999-8ff0-b9259bd9c5a5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.838766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 702/1374] 10.222.0.71 () {54 vars in 963 bytes} [Wed May 18 14:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:16.844136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e203a-3c51-43ee-aa63-542c5606ebaa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:16.844563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e203a-3c51-43ee-aa63-542c5606ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:16.845755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e203a-3c51-43ee-aa63-542c5606ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:16.903861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-628e203a-3c51-43ee-aa63-542c5606ebaa None None] MFA Rules not processed for user `e898dd74aefe470ab60a8dc9a066f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:16.905287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-628e203a-3c51-43ee-aa63-542c5606ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:16.910572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:09:16.974866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 673/1375] 10.222.0.71 () {58 vars in 1060 bytes} [Wed May 18 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:16.982557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d88f-3e13-4999-8ff0-b9259bd9c5a5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:17.000476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d88f-3e13-4999-8ff0-b9259bd9c5a5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:17.004903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7838f-4c07-43de-942c-8d6fb2c21db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:17.005580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7838f-4c07-43de-942c-8d6fb2c21db5 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:17.005857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7838f-4c07-43de-942c-8d6fb2c21db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:17.006130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7838f-4c07-43de-942c-8d6fb2c21db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:17.016420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7838f-4c07-43de-942c-8d6fb2c21db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:17.018519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7838f-4c07-43de-942c-8d6fb2c21db5 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:17.030376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 703/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:18.948951 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6471b44-4900-42b8-812a-9f61f233e85f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:18.949692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6471b44-4900-42b8-812a-9f61f233e85f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:18.949692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6471b44-4900-42b8-812a-9f61f233e85f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:18.951393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 674/1377] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:18.958438 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738dbc-07be-41ba-8653-b3d20ece246b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:18.959271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738dbc-07be-41ba-8653-b3d20ece246b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:18.959507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc738dbc-07be-41ba-8653-b3d20ece246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:18.982005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fc738dbc-07be-41ba-8653-b3d20ece246b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:18.983295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc738dbc-07be-41ba-8653-b3d20ece246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:18.991982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 704/1378] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:09:19.042632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6471b44-4900-42b8-812a-9f61f233e85f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:19.059039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6471b44-4900-42b8-812a-9f61f233e85f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:19.070188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a25aed-0185-4d3b-8a35-22bda52c7f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:19.070888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a25aed-0185-4d3b-8a35-22bda52c7f1b service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:19.071221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a25aed-0185-4d3b-8a35-22bda52c7f1b service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:19.071497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a25aed-0185-4d3b-8a35-22bda52c7f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:19.082604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a25aed-0185-4d3b-8a35-22bda52c7f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:19.084286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a25aed-0185-4d3b-8a35-22bda52c7f1b service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:19.096624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 675/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:21.603058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868064e1-4683-47cf-bd82-a22f4e767fb1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:21.603621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868064e1-4683-47cf-bd82-a22f4e767fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:21.604006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868064e1-4683-47cf-bd82-a22f4e767fb1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:21.606774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 705/1380] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:21.616162 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79c58-8e8f-4830-b031-d6c62bcc71e3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:21.616754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79c58-8e8f-4830-b031-d6c62bcc71e3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:21.617119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae79c58-8e8f-4830-b031-d6c62bcc71e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:21.647940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dae79c58-8e8f-4830-b031-d6c62bcc71e3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:21.650039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dae79c58-8e8f-4830-b031-d6c62bcc71e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:21.664834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 676/1381] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:21.745294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868064e1-4683-47cf-bd82-a22f4e767fb1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:21.770056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868064e1-4683-47cf-bd82-a22f4e767fb1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:21.778983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4468b-2235-441c-9117-30c08dfefedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:21.780006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4468b-2235-441c-9117-30c08dfefedd service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:21.780463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4468b-2235-441c-9117-30c08dfefedd service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:21.781026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4468b-2235-441c-9117-30c08dfefedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:21.795998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4468b-2235-441c-9117-30c08dfefedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:21.798797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4468b-2235-441c-9117-30c08dfefedd service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:21.815914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 706/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:25.352135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b734d-dd9f-4f0b-9331-1f5479f4c7b8 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:25.353716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b734d-dd9f-4f0b-9331-1f5479f4c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:25.354470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b734d-dd9f-4f0b-9331-1f5479f4c7b8 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:25.364482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 677/1383] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:25 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:25.368506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c466a2e-ea96-4f13-b9ea-59c5f5f18c86 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:25.368506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c466a2e-ea96-4f13-b9ea-59c5f5f18c86 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:25.368506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c466a2e-ea96-4f13-b9ea-59c5f5f18c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:25.398144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5c466a2e-ea96-4f13-b9ea-59c5f5f18c86 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:25.400093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5c466a2e-ea96-4f13-b9ea-59c5f5f18c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:25.413958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 707/1384] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:25.464857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b734d-dd9f-4f0b-9331-1f5479f4c7b8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:25.489475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b734d-dd9f-4f0b-9331-1f5479f4c7b8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:25.503061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102cf64-02ea-4a39-a775-bdaf84afd98e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:25.503061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102cf64-02ea-4a39-a775-bdaf84afd98e service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:25.503061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102cf64-02ea-4a39-a775-bdaf84afd98e service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:25.503061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102cf64-02ea-4a39-a775-bdaf84afd98e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:25.519210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102cf64-02ea-4a39-a775-bdaf84afd98e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:25.525075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102cf64-02ea-4a39-a775-bdaf84afd98e service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:25.540868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 678/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:28.467255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cad562-175f-4c59-b2b1-87a1a7989431 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:28.467835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cad562-175f-4c59-b2b1-87a1a7989431 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:28.467835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cad562-175f-4c59-b2b1-87a1a7989431 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:28.470602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 708/1386] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:28.478608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e1d6-e7fd-467f-8770-1adaee10c5db None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:28.479303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e1d6-e7fd-467f-8770-1adaee10c5db None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:28.479303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4e1d6-e7fd-467f-8770-1adaee10c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:28.504869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-04a4e1d6-e7fd-467f-8770-1adaee10c5db None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:28.506654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-04a4e1d6-e7fd-467f-8770-1adaee10c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:28.521076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 679/1387] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:09:28.571970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cad562-175f-4c59-b2b1-87a1a7989431 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:28.597646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cad562-175f-4c59-b2b1-87a1a7989431 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:28.606336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe01b4-e6b7-480c-986a-b9366ad492eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:28.607274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe01b4-e6b7-480c-986a-b9366ad492eb service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:28.607687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe01b4-e6b7-480c-986a-b9366ad492eb service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:28.608205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe01b4-e6b7-480c-986a-b9366ad492eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:28.621027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe01b4-e6b7-480c-986a-b9366ad492eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:28.623505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe01b4-e6b7-480c-986a-b9366ad492eb service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:28.638283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 709/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:09:31.884901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9fbe3-8ec8-4a5b-8436-a975194def6b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:31.886078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9fbe3-8ec8-4a5b-8436-a975194def6b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:31.886078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9fbe3-8ec8-4a5b-8436-a975194def6b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:31.887881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 680/1389] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:09:31.896056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820d13-981f-4be2-a727-b6afcff674df None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:31.896776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820d13-981f-4be2-a727-b6afcff674df None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:31.897107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820d13-981f-4be2-a727-b6afcff674df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:31.907442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=43 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:09:31.923619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-97820d13-981f-4be2-a727-b6afcff674df None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:31.925374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-97820d13-981f-4be2-a727-b6afcff674df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:31.936835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 710/1390] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:32.002937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9fbe3-8ec8-4a5b-8436-a975194def6b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:32.020106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9fbe3-8ec8-4a5b-8436-a975194def6b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:32.027957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f5476-a476-4cad-9426-7c691a31fc8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:32.028771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f5476-a476-4cad-9426-7c691a31fc8a service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:32.029221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f5476-a476-4cad-9426-7c691a31fc8a service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:32.029221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f5476-a476-4cad-9426-7c691a31fc8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:32.046372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f5476-a476-4cad-9426-7c691a31fc8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:32.050475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f5476-a476-4cad-9426-7c691a31fc8a service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:32.064363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 681/1391] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:34.432183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f61e0-a86b-4678-88d4-48d7efebd95f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.432858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f61e0-a86b-4678-88d4-48d7efebd95f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.433169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f61e0-a86b-4678-88d4-48d7efebd95f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:34.435676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 711/1392] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:34.443612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e072-cef6-411e-bace-4158c07bfcb8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.444032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e072-cef6-411e-bace-4158c07bfcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.444466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e072-cef6-411e-bace-4158c07bfcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:34.467042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8cb7e072-cef6-411e-bace-4158c07bfcb8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:34.468299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8cb7e072-cef6-411e-bace-4158c07bfcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:34.478728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 682/1393] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:34.539508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1bfb3-8053-43f6-9723-5e7f07df5566 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.539832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1bfb3-8053-43f6-9723-5e7f07df5566 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.540110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1bfb3-8053-43f6-9723-5e7f07df5566 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:34.541521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 712/1394] 10.222.0.71 () {54 vars in 962 bytes} [Wed May 18 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:34.547939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a768b-599f-47a8-ac3d-6b9d395077f5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.548277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a768b-599f-47a8-ac3d-6b9d395077f5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.548557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a768b-599f-47a8-ac3d-6b9d395077f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:34.607634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-eb8a768b-599f-47a8-ac3d-6b9d395077f5 None None] MFA Rules not processed for user `fecaff6430634c0ba90cd9039c2a9775`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:34.609149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-eb8a768b-599f-47a8-ac3d-6b9d395077f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:34.680397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 683/1395] 10.222.0.71 () {58 vars in 1059 bytes} [Wed May 18 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:34.688865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1bfb3-8053-43f6-9723-5e7f07df5566 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:34.699710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1bfb3-8053-43f6-9723-5e7f07df5566 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:34.703370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fee6aa-9368-445d-9f19-c4c65573f494 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:34.704881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fee6aa-9368-445d-9f19-c4c65573f494 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.705340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fee6aa-9368-445d-9f19-c4c65573f494 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.705798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fee6aa-9368-445d-9f19-c4c65573f494 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:34.715468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fee6aa-9368-445d-9f19-c4c65573f494 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:34.716906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fee6aa-9368-445d-9f19-c4c65573f494 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:34.727371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 713/1396] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:34.976688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89625d26-3f9c-443d-86e1-df848484d12e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.977119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89625d26-3f9c-443d-86e1-df848484d12e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.977469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89625d26-3f9c-443d-86e1-df848484d12e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:34.979253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 684/1397] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:34.985639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c937ca-0f14-4ccd-90c4-fdd82e8e6f5b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:34.986069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c937ca-0f14-4ccd-90c4-fdd82e8e6f5b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:34.986470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c937ca-0f14-4ccd-90c4-fdd82e8e6f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:35.007693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-09c937ca-0f14-4ccd-90c4-fdd82e8e6f5b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:35.009102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-09c937ca-0f14-4ccd-90c4-fdd82e8e6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:35.018229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 714/1398] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:35.075247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89625d26-3f9c-443d-86e1-df848484d12e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:35.108660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89625d26-3f9c-443d-86e1-df848484d12e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:35.116556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4cc8d-e44a-44ed-ad86-7b0c97f43315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:35.121755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cc8d-e44a-44ed-ad86-7b0c97f43315 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:35.121755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cc8d-e44a-44ed-ad86-7b0c97f43315 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:35.121755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4cc8d-e44a-44ed-ad86-7b0c97f43315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:35.127900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4cc8d-e44a-44ed-ad86-7b0c97f43315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:35.129616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4cc8d-e44a-44ed-ad86-7b0c97f43315 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:35.139812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 685/1399] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:09:35.489787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ccd0f-8c8b-4e72-84e4-f1c28b760ad9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:35.490409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ccd0f-8c8b-4e72-84e4-f1c28b760ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:35.490409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ccd0f-8c8b-4e72-84e4-f1c28b760ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:35.580756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-af7ccd0f-8c8b-4e72-84e4-f1c28b760ad9 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:35.582873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-af7ccd0f-8c8b-4e72-84e4-f1c28b760ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:35.825816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 715/1400] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:35.878225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fef9ca-3e0d-485b-b4b4-ad19ec210f03 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:35.879084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fef9ca-3e0d-485b-b4b4-ad19ec210f03 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:35.879259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fef9ca-3e0d-485b-b4b4-ad19ec210f03 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:35.880727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 686/1401] 10.222.0.71 () {54 vars in 942 bytes} [Wed May 18 14:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:35.888371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8702a6-86ed-4f52-aeb6-6c04a603063b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:35.889004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8702a6-86ed-4f52-aeb6-6c04a603063b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:35.889599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8702a6-86ed-4f52-aeb6-6c04a603063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:35.949656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0f8702a6-86ed-4f52-aeb6-6c04a603063b None None] MFA Rules not processed for user `98fdd10e85dd44e9a952b25557a8236f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:35.950889 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f8702a6-86ed-4f52-aeb6-6c04a603063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:36.045467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 716/1402] 10.222.0.71 () {58 vars in 1039 bytes} [Wed May 18 14:09:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:36.058988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fef9ca-3e0d-485b-b4b4-ad19ec210f03 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:36.087796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fef9ca-3e0d-485b-b4b4-ad19ec210f03 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:36.089257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d9500-1f62-4e01-af62-9ce788d0e28f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:36.090081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d9500-1f62-4e01-af62-9ce788d0e28f service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:36.090571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d9500-1f62-4e01-af62-9ce788d0e28f service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:36.090924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d9500-1f62-4e01-af62-9ce788d0e28f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:36.100504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d9500-1f62-4e01-af62-9ce788d0e28f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:36.102208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d9500-1f62-4e01-af62-9ce788d0e28f service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:36.108334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:09:36.113225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 687/1403] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:09:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:09:37.996418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503038fc-6af2-4ad3-a3cc-92c8c55d3f8d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:37.997381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503038fc-6af2-4ad3-a3cc-92c8c55d3f8d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:37.998228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503038fc-6af2-4ad3-a3cc-92c8c55d3f8d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:38.001908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 717/1404] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:38.014393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e14e8-b1d2-4579-a3e6-7aa53721ca3e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:38.014977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e14e8-b1d2-4579-a3e6-7aa53721ca3e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:38.015320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e14e8-b1d2-4579-a3e6-7aa53721ca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:38.045525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-874e14e8-b1d2-4579-a3e6-7aa53721ca3e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:38.048472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-874e14e8-b1d2-4579-a3e6-7aa53721ca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:38.060303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 688/1405] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:38.110274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503038fc-6af2-4ad3-a3cc-92c8c55d3f8d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:38.130820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503038fc-6af2-4ad3-a3cc-92c8c55d3f8d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:38.136712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a06a0-35a1-490c-a796-d57f56029bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:38.137405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a06a0-35a1-490c-a796-d57f56029bb9 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:38.137672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a06a0-35a1-490c-a796-d57f56029bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:38.137950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a06a0-35a1-490c-a796-d57f56029bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:38.160973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a06a0-35a1-490c-a796-d57f56029bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:38.162712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a06a0-35a1-490c-a796-d57f56029bb9 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:38.167265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:09:38.175370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 718/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:41.869030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c63d1-1a10-441a-91be-6d104afbb815 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:41.869610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c63d1-1a10-441a-91be-6d104afbb815 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:41.869765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c63d1-1a10-441a-91be-6d104afbb815 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:41.872902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 689/1407] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:09:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:09:41.879159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bbaf8-6989-48e0-9b90-99653a62e6d0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:41.879677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bbaf8-6989-48e0-9b90-99653a62e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:41.879677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bbaf8-6989-48e0-9b90-99653a62e6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:41.899093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fb0bbaf8-6989-48e0-9b90-99653a62e6d0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:09:41.900320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb0bbaf8-6989-48e0-9b90-99653a62e6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:09:41.917151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 719/1408] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:09:41.955137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c63d1-1a10-441a-91be-6d104afbb815 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:09:41.970511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c63d1-1a10-441a-91be-6d104afbb815 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:09:41.976121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aca96-d66f-455e-acc4-aa67c964d4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:09:41.976765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aca96-d66f-455e-acc4-aa67c964d4c0 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:09:41.977076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aca96-d66f-455e-acc4-aa67c964d4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:09:41.977355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aca96-d66f-455e-acc4-aa67c964d4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:09:41.988721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aca96-d66f-455e-acc4-aa67c964d4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:09:41.990365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aca96-d66f-455e-acc4-aa67c964d4c0 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:09:42.004357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 690/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:09:51.893340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:09:51.996270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=9 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:10:01.326630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c36b6-b28a-48e5-b717-9b8b84bab33f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:01.327709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c36b6-b28a-48e5-b717-9b8b84bab33f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:01.328025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c36b6-b28a-48e5-b717-9b8b84bab33f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:01.329534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 720/1410] 10.222.0.71 () {54 vars in 918 bytes} [Wed May 18 14:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:01.335680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03c82-c081-4b05-8ef2-816a085b2989 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:01.336330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03c82-c081-4b05-8ef2-816a085b2989 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:01.336330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03c82-c081-4b05-8ef2-816a085b2989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:01.355209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-68e03c82-c081-4b05-8ef2-816a085b2989 None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:01.356424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-68e03c82-c081-4b05-8ef2-816a085b2989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:01.365063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 691/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Wed May 18 14:10:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:01.379693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01da6f-7a9d-4c63-a1ad-89c3f9d91d31 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:01.379994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01da6f-7a9d-4c63-a1ad-89c3f9d91d31 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:01.380266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01da6f-7a9d-4c63-a1ad-89c3f9d91d31 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:01.381656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 721/1412] 10.222.0.71 () {54 vars in 918 bytes} [Wed May 18 14:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:10:01.386259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f56335-b35f-48b3-8a64-4f6975a7ab1c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:01.386544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f56335-b35f-48b3-8a64-4f6975a7ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:01.386821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f56335-b35f-48b3-8a64-4f6975a7ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:01.406740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d8f56335-b35f-48b3-8a64-4f6975a7ab1c None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:01.408227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d8f56335-b35f-48b3-8a64-4f6975a7ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:01.417673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 692/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Wed May 18 14:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:04.272465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991605-99bb-4548-99d3-e5aa702a7455 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:04.273032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991605-99bb-4548-99d3-e5aa702a7455 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:04.273032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991605-99bb-4548-99d3-e5aa702a7455 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:04.274424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:04.280690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18bac3-54bc-47a8-8338-5e5b961433a1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:04.281205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18bac3-54bc-47a8-8338-5e5b961433a1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:04.281600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18bac3-54bc-47a8-8338-5e5b961433a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:04.299969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6a18bac3-54bc-47a8-8338-5e5b961433a1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:04.301236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6a18bac3-54bc-47a8-8338-5e5b961433a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:04.309161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:04.353284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991605-99bb-4548-99d3-e5aa702a7455 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:04.368314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991605-99bb-4548-99d3-e5aa702a7455 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:04.374049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62586fd-c4b9-4c2e-b098-e0019a433ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:04.374784 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62586fd-c4b9-4c2e-b098-e0019a433ad9 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:04.375068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62586fd-c4b9-4c2e-b098-e0019a433ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:04.375346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62586fd-c4b9-4c2e-b098-e0019a433ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:04.384521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62586fd-c4b9-4c2e-b098-e0019a433ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:04.386177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62586fd-c4b9-4c2e-b098-e0019a433ad9 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:04.398608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 723/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:05.455512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd6070-b0df-4361-b90e-5841ce2feb58 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:05.456140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd6070-b0df-4361-b90e-5841ce2feb58 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:05.456140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd6070-b0df-4361-b90e-5841ce2feb58 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:05.457629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:05.463305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431081-2d1f-4a3b-904c-fe82604277e2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:05.463915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431081-2d1f-4a3b-904c-fe82604277e2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:05.463915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb431081-2d1f-4a3b-904c-fe82604277e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:05.484908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cb431081-2d1f-4a3b-904c-fe82604277e2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:05.486163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cb431081-2d1f-4a3b-904c-fe82604277e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:05.494102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:05.681607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd6070-b0df-4361-b90e-5841ce2feb58 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:05.698968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd6070-b0df-4361-b90e-5841ce2feb58 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:05.705504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746ffdb-dfcd-42b7-b008-706971cb1925 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:05.706176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ffdb-dfcd-42b7-b008-706971cb1925 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:05.706459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ffdb-dfcd-42b7-b008-706971cb1925 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:05.706730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ffdb-dfcd-42b7-b008-706971cb1925 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:05.716007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ffdb-dfcd-42b7-b008-706971cb1925 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:05.717843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ffdb-dfcd-42b7-b008-706971cb1925 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:05.728884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 695/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:06.814216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad0bb8-2998-42d6-aaa8-0f6f64c27173 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:06.814741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad0bb8-2998-42d6-aaa8-0f6f64c27173 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:06.814741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad0bb8-2998-42d6-aaa8-0f6f64c27173 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:06.816095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:06.821685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae0b3-6d7e-46cc-92df-a6e0bc1a22d1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:06.822166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae0b3-6d7e-46cc-92df-a6e0bc1a22d1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:06.822262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aae0b3-6d7e-46cc-92df-a6e0bc1a22d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:06.844104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-12aae0b3-6d7e-46cc-92df-a6e0bc1a22d1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:06.845356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-12aae0b3-6d7e-46cc-92df-a6e0bc1a22d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:06.853574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:07.023850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad0bb8-2998-42d6-aaa8-0f6f64c27173 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:07.040595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad0bb8-2998-42d6-aaa8-0f6f64c27173 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:07.047426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed32a2-9b32-4a1d-bf05-931bdfbfa8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:07.047948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32a2-9b32-4a1d-bf05-931bdfbfa8b2 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:07.048229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32a2-9b32-4a1d-bf05-931bdfbfa8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:07.048504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed32a2-9b32-4a1d-bf05-931bdfbfa8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:07.057951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32a2-9b32-4a1d-bf05-931bdfbfa8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:07.059800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed32a2-9b32-4a1d-bf05-931bdfbfa8b2 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:07.070912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 726/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:10:08.063256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0146-fc0e-4a0e-bd0f-9f7961f5209e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:08.063793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0146-fc0e-4a0e-bd0f-9f7961f5209e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:08.063793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0146-fc0e-4a0e-bd0f-9f7961f5209e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:08.065166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:08.070591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40038e-0522-4fd9-b1e0-b580074047ed None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:08.071064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40038e-0522-4fd9-b1e0-b580074047ed None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:08.071362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40038e-0522-4fd9-b1e0-b580074047ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:08.090565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9d40038e-0522-4fd9-b1e0-b580074047ed None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:08.091801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9d40038e-0522-4fd9-b1e0-b580074047ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:08.100448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:08.256011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0146-fc0e-4a0e-bd0f-9f7961f5209e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:08.274643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0146-fc0e-4a0e-bd0f-9f7961f5209e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:08.282885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe518e0-fdd5-4b44-bc20-fc90d6ec8cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:08.284008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe518e0-fdd5-4b44-bc20-fc90d6ec8cad service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:08.284528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe518e0-fdd5-4b44-bc20-fc90d6ec8cad service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:08.285082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe518e0-fdd5-4b44-bc20-fc90d6ec8cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:08.301517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe518e0-fdd5-4b44-bc20-fc90d6ec8cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:08.304752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe518e0-fdd5-4b44-bc20-fc90d6ec8cad service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:08.321276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 698/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:09.298085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bbe1-3a75-49c1-b1e9-ea8a0317b433 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:09.298633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bbe1-3a75-49c1-b1e9-ea8a0317b433 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:09.298633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bbe1-3a75-49c1-b1e9-ea8a0317b433 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:09.299978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:09.305395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55053-4a50-4c79-a01e-61ce1acb62ab None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:09.305842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55053-4a50-4c79-a01e-61ce1acb62ab None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:09.306295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55053-4a50-4c79-a01e-61ce1acb62ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:09.335384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-33e55053-4a50-4c79-a01e-61ce1acb62ab None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:09.336888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-33e55053-4a50-4c79-a01e-61ce1acb62ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:09.347024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:09.502077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bbe1-3a75-49c1-b1e9-ea8a0317b433 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:09.519426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bbe1-3a75-49c1-b1e9-ea8a0317b433 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:09.526165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700dad6-f7ed-4b51-ac0c-5b8ce0c874ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:09.526801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700dad6-f7ed-4b51-ac0c-5b8ce0c874ac service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:09.527077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700dad6-f7ed-4b51-ac0c-5b8ce0c874ac service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:09.527344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700dad6-f7ed-4b51-ac0c-5b8ce0c874ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:09.537763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700dad6-f7ed-4b51-ac0c-5b8ce0c874ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:09.539459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700dad6-f7ed-4b51-ac0c-5b8ce0c874ac service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:09.551026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 729/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:10.519492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925857-1cfa-4831-a59d-478f878b3491 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:10.520011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925857-1cfa-4831-a59d-478f878b3491 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:10.520011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a925857-1cfa-4831-a59d-478f878b3491 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:10.521643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:10.527577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e1ac-598d-4eb0-ab70-c7a1a2a76135 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:10.528027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e1ac-598d-4eb0-ab70-c7a1a2a76135 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:10.528124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305e1ac-598d-4eb0-ab70-c7a1a2a76135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:10.546888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8305e1ac-598d-4eb0-ab70-c7a1a2a76135 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:10.548078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8305e1ac-598d-4eb0-ab70-c7a1a2a76135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:10.556183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:10:10.729356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925857-1cfa-4831-a59d-478f878b3491 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:10.744264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a925857-1cfa-4831-a59d-478f878b3491 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:10.750585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5d3c-c152-4b5a-81ca-ac19fd3c75fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:10.751250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5d3c-c152-4b5a-81ca-ac19fd3c75fa service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:10.751535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5d3c-c152-4b5a-81ca-ac19fd3c75fa service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:10.751806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5d3c-c152-4b5a-81ca-ac19fd3c75fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:10.761096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd5d3c-c152-4b5a-81ca-ac19fd3c75fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:10.762698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd5d3c-c152-4b5a-81ca-ac19fd3c75fa service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:10.774109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 701/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:11.750440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0b4b-b3d2-44e5-9b47-a76d8401140f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:11.751031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0b4b-b3d2-44e5-9b47-a76d8401140f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:11.751031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d0b4b-b3d2-44e5-9b47-a76d8401140f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:11.752419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:11.757850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9765-aaa7-4ce1-a4bf-259cb006e1bb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:11.758484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9765-aaa7-4ce1-a4bf-259cb006e1bb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:11.758484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9765-aaa7-4ce1-a4bf-259cb006e1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:11.777638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-28db9765-aaa7-4ce1-a4bf-259cb006e1bb None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:11.778846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-28db9765-aaa7-4ce1-a4bf-259cb006e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:11.787369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:11.969727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d0b4b-b3d2-44e5-9b47-a76d8401140f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:11.984076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d0b4b-b3d2-44e5-9b47-a76d8401140f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:11.989505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057d9aa-2d6f-4b18-8911-6bec1f6a8015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:11.990196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d9aa-2d6f-4b18-8911-6bec1f6a8015 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:11.990477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d9aa-2d6f-4b18-8911-6bec1f6a8015 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:11.990750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d9aa-2d6f-4b18-8911-6bec1f6a8015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:11.999860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057d9aa-2d6f-4b18-8911-6bec1f6a8015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:12.001533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057d9aa-2d6f-4b18-8911-6bec1f6a8015 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:12.011513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 732/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:12.993506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832318ef-87cc-4b6d-a879-782e0c466ce4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:12.994081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832318ef-87cc-4b6d-a879-782e0c466ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:12.994523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832318ef-87cc-4b6d-a879-782e0c466ce4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:12.996732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:13.002385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1898b6-79a8-4bd5-a3eb-5e19e89b21ea None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:13.002868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1898b6-79a8-4bd5-a3eb-5e19e89b21ea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:13.002965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1898b6-79a8-4bd5-a3eb-5e19e89b21ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:13.025702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4a1898b6-79a8-4bd5-a3eb-5e19e89b21ea None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:13.027166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4a1898b6-79a8-4bd5-a3eb-5e19e89b21ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:13.036757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:10:13.191610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832318ef-87cc-4b6d-a879-782e0c466ce4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:13.207498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832318ef-87cc-4b6d-a879-782e0c466ce4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:13.213110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a7e1e-dddd-4b06-86a2-b5c681d097a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:13.213766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a7e1e-dddd-4b06-86a2-b5c681d097a5 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:13.214047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a7e1e-dddd-4b06-86a2-b5c681d097a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:13.214323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a7e1e-dddd-4b06-86a2-b5c681d097a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:13.223989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a7e1e-dddd-4b06-86a2-b5c681d097a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:13.225623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a7e1e-dddd-4b06-86a2-b5c681d097a5 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:13.236448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 704/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:14.206748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0fb20-f3a4-4473-97c4-697e1d4d63f7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:14.207320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0fb20-f3a4-4473-97c4-697e1d4d63f7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:14.207499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0fb20-f3a4-4473-97c4-697e1d4d63f7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:14.209294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:10:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:14.216072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf929cf5-2111-403a-8d0d-8254cef80299 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:14.217094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf929cf5-2111-403a-8d0d-8254cef80299 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:14.217233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf929cf5-2111-403a-8d0d-8254cef80299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:14.243249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bf929cf5-2111-403a-8d0d-8254cef80299 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:14.244468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bf929cf5-2111-403a-8d0d-8254cef80299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:14.253364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:14.406851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0fb20-f3a4-4473-97c4-697e1d4d63f7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:14.422246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0fb20-f3a4-4473-97c4-697e1d4d63f7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:14.428299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18015806-fe16-4187-997a-3a901f58f1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:14.428992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015806-fe16-4187-997a-3a901f58f1a9 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:14.429296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015806-fe16-4187-997a-3a901f58f1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:14.429577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18015806-fe16-4187-997a-3a901f58f1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:14.439139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015806-fe16-4187-997a-3a901f58f1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:14.440723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18015806-fe16-4187-997a-3a901f58f1a9 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:14.450828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 735/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:10:16.642056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca76d-3230-4d39-b514-f4567f44d915 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:16.642878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca76d-3230-4d39-b514-f4567f44d915 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:16.642878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ca76d-3230-4d39-b514-f4567f44d915 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:16.644520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:16.650420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5c00-9edc-43f4-ad3b-9abdd66cc481 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:16.650881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5c00-9edc-43f4-ad3b-9abdd66cc481 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:16.650997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed5c00-9edc-43f4-ad3b-9abdd66cc481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:16.671741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fbed5c00-9edc-43f4-ad3b-9abdd66cc481 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:16.673051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fbed5c00-9edc-43f4-ad3b-9abdd66cc481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:16.681419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:10:16.722863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca76d-3230-4d39-b514-f4567f44d915 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:16.725309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7d9ca76d-3230-4d39-b514-f4567f44d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:16.743435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ca76d-3230-4d39-b514-f4567f44d915 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:16.748463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afe1ac-e54f-435d-b4d9-f6c2a5d2017d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:16.749399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe1ac-e54f-435d-b4d9-f6c2a5d2017d service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:16.749745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe1ac-e54f-435d-b4d9-f6c2a5d2017d service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:16.750022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afe1ac-e54f-435d-b4d9-f6c2a5d2017d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:16.761210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe1ac-e54f-435d-b4d9-f6c2a5d2017d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:16.763082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afe1ac-e54f-435d-b4d9-f6c2a5d2017d service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:16.780570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 707/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:19.260261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a8c5-5e51-4afb-9760-60efdbeb0b9b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:19.260833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a8c5-5e51-4afb-9760-60efdbeb0b9b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:19.261019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27a8c5-5e51-4afb-9760-60efdbeb0b9b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:19.262700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:19.268241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ca521-2ea8-4036-b52a-a7d8e945b181 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:19.268755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ca521-2ea8-4036-b52a-a7d8e945b181 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:19.268937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ca521-2ea8-4036-b52a-a7d8e945b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:19.287417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-128ca521-2ea8-4036-b52a-a7d8e945b181 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:19.288630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-128ca521-2ea8-4036-b52a-a7d8e945b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:19.297097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:10:19.336040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a8c5-5e51-4afb-9760-60efdbeb0b9b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:19.355433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27a8c5-5e51-4afb-9760-60efdbeb0b9b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:19.361569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e61122-1240-4f27-ac30-0ff188143f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:19.362656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e61122-1240-4f27-ac30-0ff188143f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:19.363179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e61122-1240-4f27-ac30-0ff188143f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:19.363689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e61122-1240-4f27-ac30-0ff188143f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:19.380457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e61122-1240-4f27-ac30-0ff188143f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:19.383673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e61122-1240-4f27-ac30-0ff188143f36 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:19.402588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 738/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:22.250610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a38875-9f02-4c38-801d-98380c2a4b2b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:22.251141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a38875-9f02-4c38-801d-98380c2a4b2b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:22.251141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a38875-9f02-4c38-801d-98380c2a4b2b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:22.252532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:22.258041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58183dd-2f26-4808-947a-f933cb5e6ae4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:22.258454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58183dd-2f26-4808-947a-f933cb5e6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:22.258583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58183dd-2f26-4808-947a-f933cb5e6ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:22.276195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d58183dd-2f26-4808-947a-f933cb5e6ae4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:22.277420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d58183dd-2f26-4808-947a-f933cb5e6ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:22.285684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:22.324751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a38875-9f02-4c38-801d-98380c2a4b2b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:22.330923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=55 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:10:22.336599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a38875-9f02-4c38-801d-98380c2a4b2b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:22.340219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef0e3d-cd16-491e-966c-cbb5b8b21a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:22.350543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0e3d-cd16-491e-966c-cbb5b8b21a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:22.350543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0e3d-cd16-491e-966c-cbb5b8b21a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:22.350543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef0e3d-cd16-491e-966c-cbb5b8b21a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:22.351201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef0e3d-cd16-491e-966c-cbb5b8b21a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:22.352622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef0e3d-cd16-491e-966c-cbb5b8b21a53 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:22.362293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 710/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:10:24.766113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ace15-dbdd-4b44-9937-477b94f6836d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:24.766701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ace15-dbdd-4b44-9937-477b94f6836d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:24.766701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ace15-dbdd-4b44-9937-477b94f6836d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:24.768027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:24.774026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886f10-6f24-4381-aae5-c922b0b5a497 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:24.774516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886f10-6f24-4381-aae5-c922b0b5a497 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:24.774624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88886f10-6f24-4381-aae5-c922b0b5a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:24.792646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-88886f10-6f24-4381-aae5-c922b0b5a497 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:24.793917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-88886f10-6f24-4381-aae5-c922b0b5a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:24.802488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:24.841424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ace15-dbdd-4b44-9937-477b94f6836d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:24.852801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ace15-dbdd-4b44-9937-477b94f6836d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:24.856298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78a37a-8f0c-4858-b666-74422179c757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:24.856975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78a37a-8f0c-4858-b666-74422179c757 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:24.857761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78a37a-8f0c-4858-b666-74422179c757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:24.858648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78a37a-8f0c-4858-b666-74422179c757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:24.868179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78a37a-8f0c-4858-b666-74422179c757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:24.871636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78a37a-8f0c-4858-b666-74422179c757 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:24.880771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 741/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:27.305449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299675-0675-426e-b65f-acc8fc974ed1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:27.306063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299675-0675-426e-b65f-acc8fc974ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:27.306063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94299675-0675-426e-b65f-acc8fc974ed1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:27.307359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:27.312877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9fcc-ba99-46ca-bac4-c7f30b86ee1a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:27.313338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9fcc-ba99-46ca-bac4-c7f30b86ee1a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:27.313477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef9fcc-ba99-46ca-bac4-c7f30b86ee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:27.332291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0bef9fcc-ba99-46ca-bac4-c7f30b86ee1a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:27.333530 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0bef9fcc-ba99-46ca-bac4-c7f30b86ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:27.342698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:27.380486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94299675-0675-426e-b65f-acc8fc974ed1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:27.391513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94299675-0675-426e-b65f-acc8fc974ed1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:27.395139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bf23-d46d-4b1f-b801-5f70ae5be31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:27.396037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf23-d46d-4b1f-b801-5f70ae5be31f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:27.396316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf23-d46d-4b1f-b801-5f70ae5be31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:27.396588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bf23-d46d-4b1f-b801-5f70ae5be31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:27.406690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bf23-d46d-4b1f-b801-5f70ae5be31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:27.408194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bf23-d46d-4b1f-b801-5f70ae5be31f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:27.419443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 713/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:30.027804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546871-42fb-4198-89b9-5bfd7501ba2c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:30.028396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546871-42fb-4198-89b9-5bfd7501ba2c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:30.028396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546871-42fb-4198-89b9-5bfd7501ba2c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:30.029989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:30.036452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d3e3a-8250-4bc8-974f-7ce9f848e9a1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:30.036994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d3e3a-8250-4bc8-974f-7ce9f848e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:30.037105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d3e3a-8250-4bc8-974f-7ce9f848e9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:30.055852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9a6d3e3a-8250-4bc8-974f-7ce9f848e9a1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:30.057217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9a6d3e3a-8250-4bc8-974f-7ce9f848e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:30.065284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:30.111277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd546871-42fb-4198-89b9-5bfd7501ba2c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:30.124146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd546871-42fb-4198-89b9-5bfd7501ba2c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:30.130092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42bde0-d431-49e9-92a3-d4b45ab33f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:30.130758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42bde0-d431-49e9-92a3-d4b45ab33f4f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:30.131038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42bde0-d431-49e9-92a3-d4b45ab33f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:30.131343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42bde0-d431-49e9-92a3-d4b45ab33f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:30.144360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42bde0-d431-49e9-92a3-d4b45ab33f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:30.146086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42bde0-d431-49e9-92a3-d4b45ab33f4f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:30.157319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 744/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:32.531168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901df89a-af20-4b06-8dc5-580e7d27d48e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:32.532620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901df89a-af20-4b06-8dc5-580e7d27d48e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:32.532620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901df89a-af20-4b06-8dc5-580e7d27d48e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:32.533183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:32.538522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583344-4b20-496a-95be-a0021e5b5f49 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:32.539000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583344-4b20-496a-95be-a0021e5b5f49 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:32.539113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583344-4b20-496a-95be-a0021e5b5f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:32.545866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=70 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:10:32.558483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-79583344-4b20-496a-95be-a0021e5b5f49 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:32.559673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-79583344-4b20-496a-95be-a0021e5b5f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:32.567457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:32.609949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901df89a-af20-4b06-8dc5-580e7d27d48e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:32.620658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901df89a-af20-4b06-8dc5-580e7d27d48e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:32.624526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268d7e0-0910-4d24-bc56-a55cba4675cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:32.625188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268d7e0-0910-4d24-bc56-a55cba4675cb service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:32.625471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268d7e0-0910-4d24-bc56-a55cba4675cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:32.625747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268d7e0-0910-4d24-bc56-a55cba4675cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:32.635000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268d7e0-0910-4d24-bc56-a55cba4675cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:32.636469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268d7e0-0910-4d24-bc56-a55cba4675cb service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:32.646455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 716/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:34.964692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed2f7-5ecd-436e-b6ed-e40b2c4a8166 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:34.965300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed2f7-5ecd-436e-b6ed-e40b2c4a8166 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:34.965300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ed2f7-5ecd-436e-b6ed-e40b2c4a8166 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:34.967355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:34.973048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c93b2-c571-44ac-8335-46d68bce0798 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:34.973579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c93b2-c571-44ac-8335-46d68bce0798 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:34.973579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c93b2-c571-44ac-8335-46d68bce0798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:34.991998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-173c93b2-c571-44ac-8335-46d68bce0798 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:34.993253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-173c93b2-c571-44ac-8335-46d68bce0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:35.001704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:35.039748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ed2f7-5ecd-436e-b6ed-e40b2c4a8166 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:35.051230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ed2f7-5ecd-436e-b6ed-e40b2c4a8166 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:35.055447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506109a-a2dd-405f-ae09-a336e4ddf9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:35.056109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506109a-a2dd-405f-ae09-a336e4ddf9de service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:35.056382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506109a-a2dd-405f-ae09-a336e4ddf9de service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:35.056650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506109a-a2dd-405f-ae09-a336e4ddf9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:35.065943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506109a-a2dd-405f-ae09-a336e4ddf9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:35.067338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506109a-a2dd-405f-ae09-a336e4ddf9de service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:35.078359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 747/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:37.401852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d2d5-ad17-4185-bb5f-ced06986c717 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:37.402518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d2d5-ad17-4185-bb5f-ced06986c717 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:37.402518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d2d5-ad17-4185-bb5f-ced06986c717 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:37.404518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:37.410032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ea5a6-247b-4d01-ad40-673190bdaa04 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:37.410469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ea5a6-247b-4d01-ad40-673190bdaa04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:37.410591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ea5a6-247b-4d01-ad40-673190bdaa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:37.427842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e20ea5a6-247b-4d01-ad40-673190bdaa04 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:37.429060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e20ea5a6-247b-4d01-ad40-673190bdaa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:37.437033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:37.473448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d2d5-ad17-4185-bb5f-ced06986c717 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:37.484724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d2d5-ad17-4185-bb5f-ced06986c717 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:37.488251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3899-613a-41c0-9af1-6bd0272f808a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:37.488972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3899-613a-41c0-9af1-6bd0272f808a service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:37.489201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3899-613a-41c0-9af1-6bd0272f808a service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:37.489474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3899-613a-41c0-9af1-6bd0272f808a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:37.499226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d3899-613a-41c0-9af1-6bd0272f808a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:37.500663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d3899-613a-41c0-9af1-6bd0272f808a service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:37.510750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 719/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:39.778158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79d35-9edf-4fa2-8ae9-ef08162820f4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:39.778845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79d35-9edf-4fa2-8ae9-ef08162820f4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:39.778845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79d35-9edf-4fa2-8ae9-ef08162820f4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:39.780254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:10:39.785952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c35a-b1b9-4197-930f-53c969027791 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:39.786413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c35a-b1b9-4197-930f-53c969027791 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:39.786521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c35a-b1b9-4197-930f-53c969027791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:39.805300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7124c35a-b1b9-4197-930f-53c969027791 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:10:39.806515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7124c35a-b1b9-4197-930f-53c969027791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:10:39.815422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:10:39.851125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf79d35-9edf-4fa2-8ae9-ef08162820f4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:10:39.862841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf79d35-9edf-4fa2-8ae9-ef08162820f4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:10:39.866617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f0533-b83a-4802-94eb-8662a3672b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:10:39.867251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0533-b83a-4802-94eb-8662a3672b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:10:39.869423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0533-b83a-4802-94eb-8662a3672b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:10:39.869423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f0533-b83a-4802-94eb-8662a3672b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:10:39.878263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f0533-b83a-4802-94eb-8662a3672b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:10:39.879708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f0533-b83a-4802-94eb-8662a3672b46 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:10:39.889695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 750/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:10:49.800192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=35 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:10:49.885129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=17 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:11:14.787722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbded17-0cd8-42b3-a004-6476dd992f4c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:14.788320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbded17-0cd8-42b3-a004-6476dd992f4c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:14.788320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbded17-0cd8-42b3-a004-6476dd992f4c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:14.789603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 721/1471] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:11:14.795048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4228e6-6e4c-4749-9175-d295dbc75008 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:14.795521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4228e6-6e4c-4749-9175-d295dbc75008 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:14.795628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4228e6-6e4c-4749-9175-d295dbc75008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:14.813923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ff4228e6-6e4c-4749-9175-d295dbc75008 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:14.815391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ff4228e6-6e4c-4749-9175-d295dbc75008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:14.823030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 751/1472] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:11:14.870744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05741c3-9b6a-44ef-bd74-e0f8bb0987e0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:14.871031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05741c3-9b6a-44ef-bd74-e0f8bb0987e0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:14.871309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05741c3-9b6a-44ef-bd74-e0f8bb0987e0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:14.872699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 722/1473] 10.222.0.71 () {54 vars in 962 bytes} [Wed May 18 14:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:11:14.880512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee736-e6d7-4be0-9a47-777dc23bf1c9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:14.880821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee736-e6d7-4be0-9a47-777dc23bf1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:14.881173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aee736-e6d7-4be0-9a47-777dc23bf1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:14.899589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c9aee736-e6d7-4be0-9a47-777dc23bf1c9 None None] MFA Rules not processed for user `fecaff6430634c0ba90cd9039c2a9775`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:14.900764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c9aee736-e6d7-4be0-9a47-777dc23bf1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:14.907794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 752/1474] 10.222.0.71 () {58 vars in 1059 bytes} [Wed May 18 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:11:14.915022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05741c3-9b6a-44ef-bd74-e0f8bb0987e0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:14.925602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05741c3-9b6a-44ef-bd74-e0f8bb0987e0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:14.929094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc48623-a19a-45a9-b868-4c7ef507bc78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:14.929679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc48623-a19a-45a9-b868-4c7ef507bc78 service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:14.929956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc48623-a19a-45a9-b868-4c7ef507bc78 service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:14.930225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc48623-a19a-45a9-b868-4c7ef507bc78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:14.939011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc48623-a19a-45a9-b868-4c7ef507bc78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:14.940426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc48623-a19a-45a9-b868-4c7ef507bc78 service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:14.950145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 723/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:11:17.327085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95aac2-3744-438e-9d86-545e77f7ee0c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:17.327618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95aac2-3744-438e-9d86-545e77f7ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:17.327618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95aac2-3744-438e-9d86-545e77f7ee0c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:17.329108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 753/1476] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:11:17.334541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230d5f5-eda7-4b7f-9490-1e187589c79d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:17.334995 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230d5f5-eda7-4b7f-9490-1e187589c79d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:17.335101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230d5f5-eda7-4b7f-9490-1e187589c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:17.355615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9230d5f5-eda7-4b7f-9490-1e187589c79d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:17.356508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9230d5f5-eda7-4b7f-9490-1e187589c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:17.364305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 724/1477] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:11:17.388173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95aac2-3744-438e-9d86-545e77f7ee0c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:17.400800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95aac2-3744-438e-9d86-545e77f7ee0c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:17.405859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:17.406481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:17.406756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:17.407023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:17.407741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:17.409497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:11:17.409497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:11:17.409497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:11:17.410615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a665c73-0559-4bb3-b211-92e03b14712f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:17.430427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 754/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Wed May 18 14:11:17 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:11:19.743204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39154d-8d0c-4fcc-bb07-7aefac5813d4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:19.743779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39154d-8d0c-4fcc-bb07-7aefac5813d4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:19.743779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39154d-8d0c-4fcc-bb07-7aefac5813d4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:19.746436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 725/1479] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:11:19.751673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca988ef-eee8-46c6-a543-3a0256681602 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:19.752135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca988ef-eee8-46c6-a543-3a0256681602 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:19.752240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca988ef-eee8-46c6-a543-3a0256681602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:19.770401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fca988ef-eee8-46c6-a543-3a0256681602 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:19.771857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fca988ef-eee8-46c6-a543-3a0256681602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:19.780318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 755/1480] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:11:19.824665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39154d-8d0c-4fcc-bb07-7aefac5813d4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:19.839623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39154d-8d0c-4fcc-bb07-7aefac5813d4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:19.845445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54acb3-c9b4-4280-acdd-9b0b1a6a4d87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:19.846325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54acb3-c9b4-4280-acdd-9b0b1a6a4d87 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:19.846829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54acb3-c9b4-4280-acdd-9b0b1a6a4d87 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:19.847332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54acb3-c9b4-4280-acdd-9b0b1a6a4d87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:19.857462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54acb3-c9b4-4280-acdd-9b0b1a6a4d87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:19.859066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54acb3-c9b4-4280-acdd-9b0b1a6a4d87 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:19.869063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 726/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:11:22.314992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9f12-d3a1-4e50-acee-1f3f72096a73 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:22.315618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9f12-d3a1-4e50-acee-1f3f72096a73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:22.315725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9f12-d3a1-4e50-acee-1f3f72096a73 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:22.317066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 756/1482] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:11:22.322219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f95fea-b58d-46e4-8427-dd9bbe8c82fa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:22.322637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f95fea-b58d-46e4-8427-dd9bbe8c82fa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:22.323300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f95fea-b58d-46e4-8427-dd9bbe8c82fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:22.341818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-32f95fea-b58d-46e4-8427-dd9bbe8c82fa None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:22.343016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-32f95fea-b58d-46e4-8427-dd9bbe8c82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:22.350840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 727/1483] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:11:22.387545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c9f12-d3a1-4e50-acee-1f3f72096a73 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:22.398477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c9f12-d3a1-4e50-acee-1f3f72096a73 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:22.402692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f9551-7af3-4286-8d65-2c06d6e9f05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:22.403320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9551-7af3-4286-8d65-2c06d6e9f05e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:22.403597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9551-7af3-4286-8d65-2c06d6e9f05e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:22.403874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9551-7af3-4286-8d65-2c06d6e9f05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:22.413194 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f9551-7af3-4286-8d65-2c06d6e9f05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:22.414615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f9551-7af3-4286-8d65-2c06d6e9f05e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:22.424052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 757/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:11:24.768036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747a7c-00c7-4969-a745-03c9cf72a475 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:24.768592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747a7c-00c7-4969-a745-03c9cf72a475 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:24.768592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a747a7c-00c7-4969-a745-03c9cf72a475 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:24.769908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 728/1485] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:11:24.775366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6bfa-5fc7-4c0f-a1db-dfeb14a48fc5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:24.775807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6bfa-5fc7-4c0f-a1db-dfeb14a48fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:24.776038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6bfa-5fc7-4c0f-a1db-dfeb14a48fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:24.794377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8d4d6bfa-5fc7-4c0f-a1db-dfeb14a48fc5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:24.795558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8d4d6bfa-5fc7-4c0f-a1db-dfeb14a48fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:24.803250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 758/1486] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:11:24.841408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747a7c-00c7-4969-a745-03c9cf72a475 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:24.852598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a747a7c-00c7-4969-a745-03c9cf72a475 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:24.856952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86a78d-43b9-4866-a5a0-3fc5995f3518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:24.857588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a78d-43b9-4866-a5a0-3fc5995f3518 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:24.857872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a78d-43b9-4866-a5a0-3fc5995f3518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:24.858146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86a78d-43b9-4866-a5a0-3fc5995f3518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:24.867337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a78d-43b9-4866-a5a0-3fc5995f3518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:24.868766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86a78d-43b9-4866-a5a0-3fc5995f3518 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:24.879110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 729/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:11:27.307528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a557e-583f-48a6-90a5-fe85ee1d900a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:27.308094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a557e-583f-48a6-90a5-fe85ee1d900a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:27.308094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a557e-583f-48a6-90a5-fe85ee1d900a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:27.309469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 759/1488] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:11:27.314913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9563c7b-6efe-443b-8850-1a6c18d8eba7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:27.315428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9563c7b-6efe-443b-8850-1a6c18d8eba7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:27.315538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9563c7b-6efe-443b-8850-1a6c18d8eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:27.333224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f9563c7b-6efe-443b-8850-1a6c18d8eba7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:27.334422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9563c7b-6efe-443b-8850-1a6c18d8eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:27.343391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 730/1489] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:11:27.384209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a557e-583f-48a6-90a5-fe85ee1d900a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:27.395157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a557e-583f-48a6-90a5-fe85ee1d900a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:27.399003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db3b6b-c474-4e5b-a010-aaa10f67f690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:27.399630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3b6b-c474-4e5b-a010-aaa10f67f690 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:27.399906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3b6b-c474-4e5b-a010-aaa10f67f690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:27.400175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3b6b-c474-4e5b-a010-aaa10f67f690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:27.409911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db3b6b-c474-4e5b-a010-aaa10f67f690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:27.411331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db3b6b-c474-4e5b-a010-aaa10f67f690 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:27.421875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 760/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:11:30.285794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799c6f-717a-4126-bc56-20cefd2f76af None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:30.286398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799c6f-717a-4126-bc56-20cefd2f76af None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:30.286398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799c6f-717a-4126-bc56-20cefd2f76af None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:30.287771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 731/1491] 10.222.0.71 () {54 vars in 926 bytes} [Wed May 18 14:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:11:30.293888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c037-0f73-4907-9cc3-87710c35eb41 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:30.294335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c037-0f73-4907-9cc3-87710c35eb41 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:30.294465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c037-0f73-4907-9cc3-87710c35eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:30.312141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-aac4c037-0f73-4907-9cc3-87710c35eb41 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:11:30.313376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aac4c037-0f73-4907-9cc3-87710c35eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:11:30.323373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 761/1492] 10.222.0.71 () {58 vars in 1023 bytes} [Wed May 18 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:11:30.363627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799c6f-717a-4126-bc56-20cefd2f76af None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:11:30.374816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799c6f-717a-4126-bc56-20cefd2f76af None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:11:30.378554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f59bb6-af9b-4ba4-a68f-bdb12fbcbb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:11:30.379206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59bb6-af9b-4ba4-a68f-bdb12fbcbb4d service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:11:30.379471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59bb6-af9b-4ba4-a68f-bdb12fbcbb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:11:30.379750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59bb6-af9b-4ba4-a68f-bdb12fbcbb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:11:30.389426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f59bb6-af9b-4ba4-a68f-bdb12fbcbb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:11:30.390855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f59bb6-af9b-4ba4-a68f-bdb12fbcbb4d service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:11:30.401330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 732/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:11:40.307104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=33 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:11:40.396378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=33 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:13:32.303364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.303963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.303963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.321923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:13:32.323125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:32.330979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 762/1494] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:13:32.340473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.341047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.341149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.360001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:13:32.361269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:32.370038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 733/1495] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:13:32.374685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:32.385002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716ed95-18b4-42bd-ac90-36989023359e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:32.389542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:32.390195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.390480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.390763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.391486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:13:32.391792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:32.392943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:32.392943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:13:32.392943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:13:32.393798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:32.406743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 763/1496] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:13:32.415540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:32.425077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23262c-2b29-4b91-be80-24baaeb0294f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:32.430253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:32.430944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.431206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.431486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.432176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:32.434109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:32.434109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:13:32.434109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:13:32.435334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:32.565436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 734/1497] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:13:32 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:13:32.570334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:32.580327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757669ed-530c-48b2-a183-5d54d7014642 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:32.639106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:32.639787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.640078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.640353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.641082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:32.642103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:32.642103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:13:32.642103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:13:32.643307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:32.752621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 764/1498] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:13:32 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:13:32.757761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:32.768406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2828b-ebdc-42ef-8d8b-020edbc49939 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:32.773552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:32.774285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.774569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.774845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.775570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:32.776617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:32.776617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:13:32.776617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:13:32.777550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:32.791076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 735/1499] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:13:32.795495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:32.806090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f397884-56dd-4d1a-9b92-b47b8358ae29 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:32.810770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:32.811424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.811706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.811982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.812692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:32.813767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:32.813767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:13:32.813767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:13:32.814643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c2308-c4fd-4f64-875b-2588b3dbae65 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:32.829167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 765/1500] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:13:32.833786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:32.844088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd51eb-0168-4ff5-a116-2dbc4f4b5dd1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:32.849527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:32.850433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.850744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.851103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] PATH_INFO: `/v3/projects/4dff16bfb8ac43b58646db919e73feee/users/eaf3941ab05943ddacf8eb86d81dd234/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:32.870650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dff16bfb8ac43b58646db919e73feee, user_id=eaf3941ab05943ddacf8eb86d81dd234, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:32.871686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:32.871686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:13:32.871686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:13:32.873729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8975dd-9b1e-4e68-bf0d-67ad9c0b1438 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:32.972697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 736/1501] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:13:32 2022] PUT /identity/v3/projects/4dff16bfb8ac43b58646db919e73feee/users/eaf3941ab05943ddacf8eb86d81dd234/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:13:32.984199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada710-62f7-411a-8811-96408246cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:32.984490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada710-62f7-411a-8811-96408246cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:32.984771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada710-62f7-411a-8811-96408246cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.014675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-69ada710-62f7-411a-8811-96408246cfc2 None None] MFA Rules not processed for user `eaf3941ab05943ddacf8eb86d81dd234`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:13:33.015890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-69ada710-62f7-411a-8811-96408246cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:33.081526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 766/1502] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:13:33.095185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576a00e-96b8-4450-9160-21abad3407cb None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.095472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576a00e-96b8-4450-9160-21abad3407cb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.095756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576a00e-96b8-4450-9160-21abad3407cb None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.097160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 737/1503] 10.222.0.71 () {54 vars in 963 bytes} [Wed May 18 14:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:13:33.102667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040962-1942-4fab-a14d-060c7d40c9af None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.102947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040962-1942-4fab-a14d-060c7d40c9af None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.103218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040962-1942-4fab-a14d-060c7d40c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.121604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e1040962-1942-4fab-a14d-060c7d40c9af None None] MFA Rules not processed for user `e898dd74aefe470ab60a8dc9a066f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:13:33.122785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e1040962-1942-4fab-a14d-060c7d40c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:33.171851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:13:33.180848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 767/1504] 10.222.0.71 () {58 vars in 1060 bytes} [Wed May 18 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:13:33.188686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576a00e-96b8-4450-9160-21abad3407cb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:33.200257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576a00e-96b8-4450-9160-21abad3407cb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:33.209371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:33.209371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.209371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.209371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.215810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:33.217275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:33.227441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 738/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:13:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:13:33.271399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457e828-68ae-44d7-9335-e0a2374d2710 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.271680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457e828-68ae-44d7-9335-e0a2374d2710 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.272077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457e828-68ae-44d7-9335-e0a2374d2710 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.273582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 768/1506] 10.222.0.71 () {52 vars in 829 bytes} [Wed May 18 14:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:13:33.277279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:33.340412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77197d0-4a3e-40ca-9472-75f075b4bc9d service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:33.344890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:33.345765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.346047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.346322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] PATH_INFO: `/v3/users/eaf3941ab05943ddacf8eb86d81dd234` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.348068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf3941ab05943ddacf8eb86d81dd234)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:33.349198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:33.349198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:13:33.349198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:13:33.350451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:33.579390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf3941ab05943ddacf8eb86d81dd234'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:33.580027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf3941ab05943ddacf8eb86d81dd234'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:33.580729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf3941ab05943ddacf8eb86d81dd234'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:33.660895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf3941ab05943ddacf8eb86d81dd234'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:33.679944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf3941ab05943ddacf8eb86d81dd234'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:33.688976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:13:33.699717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 739/1507] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:13:33 2022] DELETE /identity/v3/users/eaf3941ab05943ddacf8eb86d81dd234 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:13:33.704453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.705026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.705136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.724396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:13:33.725880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:33.785603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 769/1508] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:13:33.795778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:33.797233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:33.855964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4337-ff2c-4ff6-b599-349d4061b0c9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:33.859660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c3f99-6330-460d-bdd3-0daa61776220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:33.860304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c3f99-6330-460d-bdd3-0daa61776220 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:33.860583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c3f99-6330-460d-bdd3-0daa61776220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:33.860900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c3f99-6330-460d-bdd3-0daa61776220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:33.870354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c3f99-6330-460d-bdd3-0daa61776220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:33.871788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c3f99-6330-460d-bdd3-0daa61776220 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:33.881919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 740/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:13:34.374337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:13:34.377820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:13:34.388550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd829c5-bca3-476b-8c64-e66ae03e3c5f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:13:34.396020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:13:34.396914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:13:34.397247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:13:34.397455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] PATH_INFO: `/v3/projects/4dff16bfb8ac43b58646db919e73feee` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:13:34.398672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dff16bfb8ac43b58646db919e73feee)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:13:34.399689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:13:34.399689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:13:34.399689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:13:34.400910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:13:34.519255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dff16bfb8ac43b58646db919e73feee', 'request_id': 'req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:34.615076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dff16bfb8ac43b58646db919e73feee', 'request_id': 'req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:34.622418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dff16bfb8ac43b58646db919e73feee', 'request_id': 'req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:34.641308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] The token cache is being invalidate because project 4dff16bfb8ac43b58646db919e73feee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:13:34.641647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:34.642245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7f2d4154-297e-4ba7-9b2d-4277e49c5dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:13:34.643886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 770/1510] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:13:34 2022] DELETE /identity/v3/projects/4dff16bfb8ac43b58646db919e73feee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:13:43.877007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=29 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:13:44.638178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:15:19.867643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a976-feb8-4e0d-92e0-4403bef63194 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:19.868263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a976-feb8-4e0d-92e0-4403bef63194 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:19.868263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0a976-feb8-4e0d-92e0-4403bef63194 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:19.869608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:19.874660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657294-290f-4f66-996c-51aaafccd3a2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:19.875104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657294-290f-4f66-996c-51aaafccd3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:19.875262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657294-290f-4f66-996c-51aaafccd3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:19.893886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-55657294-290f-4f66-996c-51aaafccd3a2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:19.895073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-55657294-290f-4f66-996c-51aaafccd3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:19.954562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:20.129755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a976-feb8-4e0d-92e0-4403bef63194 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:20.131712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b4c0a976-feb8-4e0d-92e0-4403bef63194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:20.208502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0a976-feb8-4e0d-92e0-4403bef63194 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:20.214071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072acc7-63a2-4272-8dc7-c9ea04e8bb32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:20.214715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072acc7-63a2-4272-8dc7-c9ea04e8bb32 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:20.214991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072acc7-63a2-4272-8dc7-c9ea04e8bb32 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:20.215263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072acc7-63a2-4272-8dc7-c9ea04e8bb32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:20.225133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072acc7-63a2-4272-8dc7-c9ea04e8bb32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:20.226727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072acc7-63a2-4272-8dc7-c9ea04e8bb32 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:20.236564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 742/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:20.362239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e5ca-c22b-430e-94ca-7b0ee1c35f97 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:20.362532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e5ca-c22b-430e-94ca-7b0ee1c35f97 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:20.363545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e5ca-c22b-430e-94ca-7b0ee1c35f97 None None] PATH_INFO: `/v3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:20.364853 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 772/1514] 10.222.0.72 () {54 vars in 925 bytes} [Wed May 18 14:15:20 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:15:20.388848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e32e17-af18-4682-ae73-1aafa69da622 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:20.389074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e32e17-af18-4682-ae73-1aafa69da622 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:20.389354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e32e17-af18-4682-ae73-1aafa69da622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:20.409030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-99e32e17-af18-4682-ae73-1aafa69da622 None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:20.410281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99e32e17-af18-4682-ae73-1aafa69da622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:20.475544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 743/1515] 10.222.0.72 () {58 vars in 1015 bytes} [Wed May 18 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:21.158521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc291-a93c-437e-85df-3b9772b079e1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:21.159092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc291-a93c-437e-85df-3b9772b079e1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:21.159092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc291-a93c-437e-85df-3b9772b079e1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:21.160525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 773/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:21.165330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486b7f-adfd-4004-ac77-15936349f737 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:21.165752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486b7f-adfd-4004-ac77-15936349f737 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:21.165889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12486b7f-adfd-4004-ac77-15936349f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:21.184371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-12486b7f-adfd-4004-ac77-15936349f737 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:21.185606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-12486b7f-adfd-4004-ac77-15936349f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:21.194215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 744/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:21.346878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc291-a93c-437e-85df-3b9772b079e1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:21.361842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc291-a93c-437e-85df-3b9772b079e1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:21.367622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193224e-e4aa-43b7-bb5c-85e3795aada2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:21.368249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193224e-e4aa-43b7-bb5c-85e3795aada2 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:21.368527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193224e-e4aa-43b7-bb5c-85e3795aada2 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:21.368830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193224e-e4aa-43b7-bb5c-85e3795aada2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:21.378240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193224e-e4aa-43b7-bb5c-85e3795aada2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:21.380165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193224e-e4aa-43b7-bb5c-85e3795aada2 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:21.389826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 774/1518] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:24.611981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f5333-1166-4522-b778-57aec0bc95ce None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:24.612579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f5333-1166-4522-b778-57aec0bc95ce None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:24.612579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f5333-1166-4522-b778-57aec0bc95ce None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:24.613941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 745/1519] 10.222.0.71 () {54 vars in 960 bytes} [Wed May 18 14:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:24.618855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daec327-cde9-4768-926c-3279e299f80d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:24.619308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daec327-cde9-4768-926c-3279e299f80d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:24.619408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daec327-cde9-4768-926c-3279e299f80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:24.640210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1daec327-cde9-4768-926c-3279e299f80d None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:24.641425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1daec327-cde9-4768-926c-3279e299f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:24.651749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 775/1520] 10.222.0.71 () {58 vars in 1057 bytes} [Wed May 18 14:15:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:24.659306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f5333-1166-4522-b778-57aec0bc95ce None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:24.675991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f5333-1166-4522-b778-57aec0bc95ce None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:24.682741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e8ef6-3769-4496-a449-a6076897bd0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:24.683491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e8ef6-3769-4496-a449-a6076897bd0c service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:24.683985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e8ef6-3769-4496-a449-a6076897bd0c service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:24.685183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e8ef6-3769-4496-a449-a6076897bd0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:24.698988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e8ef6-3769-4496-a449-a6076897bd0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:24.701283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e8ef6-3769-4496-a449-a6076897bd0c service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:24.713640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 746/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:32.735834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04fd6-2423-4e7b-892d-61cbe4941e62 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:32.736432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04fd6-2423-4e7b-892d-61cbe4941e62 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:32.736432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04fd6-2423-4e7b-892d-61cbe4941e62 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:32.738098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:32.743438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f416789-eb60-46a3-8568-c90627a52fa1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:32.743966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f416789-eb60-46a3-8568-c90627a52fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:32.744073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f416789-eb60-46a3-8568-c90627a52fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:32.764359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8f416789-eb60-46a3-8568-c90627a52fa1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:32.766029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8f416789-eb60-46a3-8568-c90627a52fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:32.774414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:32.930483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04fd6-2423-4e7b-892d-61cbe4941e62 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:32.945659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04fd6-2423-4e7b-892d-61cbe4941e62 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:32.951086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2dc1d-3f28-4dfc-a97e-e2f7af9c5334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:32.951745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2dc1d-3f28-4dfc-a97e-e2f7af9c5334 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:32.952040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2dc1d-3f28-4dfc-a97e-e2f7af9c5334 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:32.952313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2dc1d-3f28-4dfc-a97e-e2f7af9c5334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:32.961510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2dc1d-3f28-4dfc-a97e-e2f7af9c5334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:32.963099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2dc1d-3f28-4dfc-a97e-e2f7af9c5334 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:32.972518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 777/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:33.973625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49adac6-7eda-408b-b7c2-fdd561216c41 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:33.974295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49adac6-7eda-408b-b7c2-fdd561216c41 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:33.974412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49adac6-7eda-408b-b7c2-fdd561216c41 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:33.975708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 14:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:33.980672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80af7b-2c80-4dc7-80c0-8e80604355e3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:33.981097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80af7b-2c80-4dc7-80c0-8e80604355e3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:33.981264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80af7b-2c80-4dc7-80c0-8e80604355e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:33.999755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-df80af7b-2c80-4dc7-80c0-8e80604355e3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:34.001006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df80af7b-2c80-4dc7-80c0-8e80604355e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:34.010311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:34.162309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49adac6-7eda-408b-b7c2-fdd561216c41 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:34.177421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49adac6-7eda-408b-b7c2-fdd561216c41 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:34.182887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171d611-0359-446e-833d-086a5792b147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:34.183535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171d611-0359-446e-833d-086a5792b147 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:34.183817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171d611-0359-446e-833d-086a5792b147 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:34.184090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171d611-0359-446e-833d-086a5792b147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:34.192740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171d611-0359-446e-833d-086a5792b147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:34.194367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171d611-0359-446e-833d-086a5792b147 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:34.203911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 749/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:38.300969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba2c1-db3d-40cd-9c29-907e3ce40623 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:38.301521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba2c1-db3d-40cd-9c29-907e3ce40623 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:38.301521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aba2c1-db3d-40cd-9c29-907e3ce40623 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:38.302893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:38.309223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c9de-31b9-47c5-876b-40cc066e0ac3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:38.309673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c9de-31b9-47c5-876b-40cc066e0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:38.309780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c9de-31b9-47c5-876b-40cc066e0ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:38.328426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-96a3c9de-31b9-47c5-876b-40cc066e0ac3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:38.329664 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-96a3c9de-31b9-47c5-876b-40cc066e0ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:38.337934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:15:38.375097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aba2c1-db3d-40cd-9c29-907e3ce40623 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:38.376821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-41aba2c1-db3d-40cd-9c29-907e3ce40623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:38.435177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aba2c1-db3d-40cd-9c29-907e3ce40623 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:38.438864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ede6a0-b95e-468e-9be9-49cda0f3880f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:38.439535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede6a0-b95e-468e-9be9-49cda0f3880f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:38.439813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede6a0-b95e-468e-9be9-49cda0f3880f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:38.440087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede6a0-b95e-468e-9be9-49cda0f3880f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:38.450077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ede6a0-b95e-468e-9be9-49cda0f3880f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:38.451492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ede6a0-b95e-468e-9be9-49cda0f3880f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:38.460701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 780/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:40.826490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0537373-65ed-44ad-890e-eb0ed1ede0f6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:40.827059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0537373-65ed-44ad-890e-eb0ed1ede0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:40.827232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0537373-65ed-44ad-890e-eb0ed1ede0f6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:40.828633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:40.834316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71f80-19b6-4a7e-8d14-2f5ce741a53c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:40.834809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71f80-19b6-4a7e-8d14-2f5ce741a53c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:40.834934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71f80-19b6-4a7e-8d14-2f5ce741a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:40.860675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-51c71f80-19b6-4a7e-8d14-2f5ce741a53c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:40.861903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-51c71f80-19b6-4a7e-8d14-2f5ce741a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:40.870234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:40.907791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0537373-65ed-44ad-890e-eb0ed1ede0f6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:40.909492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0537373-65ed-44ad-890e-eb0ed1ede0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:40.923141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0537373-65ed-44ad-890e-eb0ed1ede0f6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:40.926705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322871-8c33-43ff-8776-39081f5fa291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:40.927331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322871-8c33-43ff-8776-39081f5fa291 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:40.927609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322871-8c33-43ff-8776-39081f5fa291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:40.927879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322871-8c33-43ff-8776-39081f5fa291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:40.937931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e322871-8c33-43ff-8776-39081f5fa291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:40.939371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e322871-8c33-43ff-8776-39081f5fa291 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:40.950539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 752/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:44.848980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed843df-6fb8-4aee-807e-fb86dd2bd2a7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:44.849559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed843df-6fb8-4aee-807e-fb86dd2bd2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:44.849559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed843df-6fb8-4aee-807e-fb86dd2bd2a7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:44.850873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:44.857154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0f884-655b-48b5-9923-645a9a03c66d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:44.857660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0f884-655b-48b5-9923-645a9a03c66d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:44.857772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0f884-655b-48b5-9923-645a9a03c66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:44.864038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:15:44.876754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9ea0f884-655b-48b5-9923-645a9a03c66d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:44.881342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9ea0f884-655b-48b5-9923-645a9a03c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:44.886065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:15:45.164898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed843df-6fb8-4aee-807e-fb86dd2bd2a7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:45.167346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4ed843df-6fb8-4aee-807e-fb86dd2bd2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:45.173199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=75 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:15:45.225067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed843df-6fb8-4aee-807e-fb86dd2bd2a7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:45.229334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007147a1-49a6-4de3-a9f2-eba2c61a35a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:45.229992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007147a1-49a6-4de3-a9f2-eba2c61a35a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:45.230271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007147a1-49a6-4de3-a9f2-eba2c61a35a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:45.230543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007147a1-49a6-4de3-a9f2-eba2c61a35a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:45.241174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007147a1-49a6-4de3-a9f2-eba2c61a35a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:45.242622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007147a1-49a6-4de3-a9f2-eba2c61a35a5 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:45.252550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 783/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:47.617270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fcf09-d84a-4609-9372-36c0af9c536a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:47.617845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fcf09-d84a-4609-9372-36c0af9c536a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:47.617845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fcf09-d84a-4609-9372-36c0af9c536a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:47.619966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 14:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:15:47.625480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102581-f8aa-44c9-8a5d-f19c292ef65d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:47.625926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102581-f8aa-44c9-8a5d-f19c292ef65d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:47.626032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102581-f8aa-44c9-8a5d-f19c292ef65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:47.645969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e0102581-f8aa-44c9-8a5d-f19c292ef65d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:15:47.647441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e0102581-f8aa-44c9-8a5d-f19c292ef65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:47.655308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 14:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:15:47.926244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fcf09-d84a-4609-9372-36c0af9c536a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:15:47.927910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a77fcf09-d84a-4609-9372-36c0af9c536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:15:47.941353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fcf09-d84a-4609-9372-36c0af9c536a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:15:47.944749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a8807-8dbe-439a-894f-760dc758650c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:15:47.945403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a8807-8dbe-439a-894f-760dc758650c service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:15:47.945678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a8807-8dbe-439a-894f-760dc758650c service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:15:47.945948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a8807-8dbe-439a-894f-760dc758650c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:15:47.955557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a8807-8dbe-439a-894f-760dc758650c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:15:47.956994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a8807-8dbe-439a-894f-760dc758650c service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:15:47.966579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 755/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:15:57.640568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=28 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:15:57.962090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:22.266447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.267093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.267093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.302262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.303486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.321508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 785/1540] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.332428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.333639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.334142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.367220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.368821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.387563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 756/1541] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.391856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:22.406683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cba6c-a6b6-4f24-a2af-bfceb584af37 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:22.413160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:22.413850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.414128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.414398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.415147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:22.415451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:22.417738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db44822-0b7c-45c5-9613-6feaa828c4df admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:22.436770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 786/1542] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:22.444934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:22.458645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a304772-7961-4d66-aa4a-6b2268a5acdf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:22.469792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beeb0c-98e5-43ad-8afa-558bd64d4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:22.470899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beeb0c-98e5-43ad-8afa-558bd64d4d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.471401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beeb0c-98e5-43ad-8afa-558bd64d4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.471896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beeb0c-98e5-43ad-8afa-558bd64d4d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.472882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9beeb0c-98e5-43ad-8afa-558bd64d4d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:22.475321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9beeb0c-98e5-43ad-8afa-558bd64d4d9e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:22.491318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916280b9-f87b-4128-b3e5-a8ac1e374b05 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.491524 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916280b9-f87b-4128-b3e5-a8ac1e374b05 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.491788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916280b9-f87b-4128-b3e5-a8ac1e374b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.534045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-916280b9-f87b-4128-b3e5-a8ac1e374b05 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.535685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-916280b9-f87b-4128-b3e5-a8ac1e374b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.550750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 787/1543] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:17:22.563151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.566352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.566352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.593287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.594069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.610818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 788/1544] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:17:22.615814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:22.628514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 757/1545] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/projects => generated 399 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:22.630345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.630914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.631420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.639953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dcc68-5f90-41f7-816a-6941fc57f5ac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:22.702920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.704767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.772430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:22.773106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.773389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.773929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.774656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:22.774966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:22.777500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ab4ef-0a37-4346-a8b2-4a56c3c19ee0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:22.796887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 789/1546] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:17:22.801350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714cf6-a828-4bc6-883f-e7be238db188 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.801350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714cf6-a828-4bc6-883f-e7be238db188 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.801350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75714cf6-a828-4bc6-883f-e7be238db188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.817266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 758/1547] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.819390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:22.828258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-75714cf6-a828-4bc6-883f-e7be238db188 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.829665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-75714cf6-a828-4bc6-883f-e7be238db188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.835329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571e0e-9d4d-40b3-b6ad-3ef3a4765c43 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:22.837986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 790/1548] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.839354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767123-a92a-4e74-97fb-4eb1bfc3c9a4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.839640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767123-a92a-4e74-97fb-4eb1bfc3c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.839917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83767123-a92a-4e74-97fb-4eb1bfc3c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.840734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:22.841558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.841981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.842287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.843041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:22.844137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:17:22.844137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:17:22.844137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:17:22.845560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:22.864746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83767123-a92a-4e74-97fb-4eb1bfc3c9a4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.866001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83767123-a92a-4e74-97fb-4eb1bfc3c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.874477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 791/1549] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.875693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bacf0-5709-4040-9b98-57f15358c47f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.881680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bacf0-5709-4040-9b98-57f15358c47f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.881680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bacf0-5709-4040-9b98-57f15358c47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.895972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-079bacf0-5709-4040-9b98-57f15358c47f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.897203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-079bacf0-5709-4040-9b98-57f15358c47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.905954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 792/1550] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.907170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe51a1-8209-437f-9837-a3a9e0399ee0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.907446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe51a1-8209-437f-9837-a3a9e0399ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.907718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe51a1-8209-437f-9837-a3a9e0399ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.925723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 759/1551] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:22.925723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:22.930739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-babe51a1-8209-437f-9837-a3a9e0399ee0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.930739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-babe51a1-8209-437f-9837-a3a9e0399ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.933634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d384d-6d4a-40c2-8102-509d3e526a0d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:22.938203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697c10f-6860-4a7c-bce8-af988441fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:22.940837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 793/1552] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.940987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c10f-6860-4a7c-bce8-af988441fd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.940987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c10f-6860-4a7c-bce8-af988441fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.940987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697c10f-6860-4a7c-bce8-af988441fd58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.941242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8561f2-ae8e-436a-a437-ef2c301981d9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.941327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c10f-6860-4a7c-bce8-af988441fd58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:22.941421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8561f2-ae8e-436a-a437-ef2c301981d9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.941421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8561f2-ae8e-436a-a437-ef2c301981d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:22.942072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697c10f-6860-4a7c-bce8-af988441fd58 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:22.967255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4e8561f2-ae8e-436a-a437-ef2c301981d9 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:22.968498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e8561f2-ae8e-436a-a437-ef2c301981d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:22.976581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 794/1553] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:22.985620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03fe-30e2-4a18-9f17-654a833c9102 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:22.985906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03fe-30e2-4a18-9f17-654a833c9102 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:22.986184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c03fe-30e2-4a18-9f17-654a833c9102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.004451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c58c03fe-30e2-4a18-9f17-654a833c9102 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:23.005716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c58c03fe-30e2-4a18-9f17-654a833c9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:23.014527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 795/1554] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:23.015869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf7fe-1064-4c09-a0c7-ba0a31d19cdf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.016129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf7fe-1064-4c09-a0c7-ba0a31d19cdf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.016372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf7fe-1064-4c09-a0c7-ba0a31d19cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.035293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-69cbf7fe-1064-4c09-a0c7-ba0a31d19cdf None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:23.036407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-69cbf7fe-1064-4c09-a0c7-ba0a31d19cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:23.044490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 796/1555] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:23.051122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.051122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.051122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.054757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 760/1556] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:22 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.054757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b6e29-525f-4b00-8b4d-015f44644053 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.054757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b6e29-525f-4b00-8b4d-015f44644053 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.054757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b6e29-525f-4b00-8b4d-015f44644053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.067444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:23.068901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:23.076025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d48b6e29-525f-4b00-8b4d-015f44644053 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:23.079825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d48b6e29-525f-4b00-8b4d-015f44644053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:23.132915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 797/1557] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:23.133770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.141595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 761/1558] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:23.143054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b500-da21-4377-a435-a7777baaf700 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.143369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b500-da21-4377-a435-a7777baaf700 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.143652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297b500-da21-4377-a435-a7777baaf700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.144219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf2aca-7352-4dd7-936d-b072e287638d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.149335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67a2c4-78ea-40a8-b717-d849080637c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.150018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a2c4-78ea-40a8-b717-d849080637c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.150295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a2c4-78ea-40a8-b717-d849080637c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.150568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a2c4-78ea-40a8-b717-d849080637c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.151301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a2c4-78ea-40a8-b717-d849080637c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.153175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67a2c4-78ea-40a8-b717-d849080637c3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.163366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 798/1559] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:23.163695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3297b500-da21-4377-a435-a7777baaf700 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:23.164628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.164942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.165037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3297b500-da21-4377-a435-a7777baaf700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:23.165220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.173385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:23.173739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 762/1560] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:23.174556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297b500-da21-4377-a435-a7777baaf700 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.184558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297b500-da21-4377-a435-a7777baaf700 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.189193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.189391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:23.189848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.190136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.190403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.190592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:23.191123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:23.191429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.192449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 14:17:23.192449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:17:23.192449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:17:23.193367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.199120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 799/1561] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:23.199912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.206338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 763/1562] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:23.207098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.210687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8412633-8d16-4a0b-a45c-9bd092aaacb2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.217016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.217676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.217953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.218222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.218970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:23.219273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.220994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.223499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b5668-0627-4983-8502-9063652e8b2a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.228596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.229399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.230199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.230531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.232114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.233234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 800/1563] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:23.233877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.234152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.246013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:23.246497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f6018-acc1-46b1-af28-7d2bcf24b381 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.251169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.251860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.259866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.259866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.259866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:23.259866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.259866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.267848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 801/1564] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:23.268866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.279591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01692643-5500-4a83-b042-40045ed43e24 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.284140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.284800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.285083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.285403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.286067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:23.286362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.287934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.299628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 802/1565] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:23.301196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.310242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d00000-a3ee-4321-ab66-e50c45d0fb24 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.315289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.318497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.318497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.318497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.318497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.318871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.319017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 764/1566] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.319841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.330904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 803/1567] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:23.331768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.332378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21983f4d-98a3-4765-98a8-58b034f51277 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.337309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.337967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.340410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.340410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.340588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:23.340826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.342444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.343226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f695-39dd-4eee-9089-cdc974febe33 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.348010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.348663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.348979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.349258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.350015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:23.350555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.352176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.355308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 765/1568] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:23.356315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.366230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23702f1-22ac-48ad-8c11-d4dc5a6e2d0e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.373455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 804/1569] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:23.373455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.375850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.376517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.376812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.377106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.377788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.378812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcd1e2-18ca-4ed5-ad1b-d16ffd26238f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.379693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.383481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.384133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.384413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.384694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.385477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.387197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:17:23.387197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:17:23.387197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:17:23.388526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.475615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 766/1570] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.475615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.510158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 805/1571] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.510158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.541116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5036f-f6f3-4c89-b8ba-e77b4d20b1e2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.582780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ae66c-a305-495f-9efd-b1d0be07456a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.589271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.589951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.590232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.590510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.591207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.593232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.606038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.606751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.607032 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.607304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.607994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.610046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.711973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 806/1572] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.711973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.769608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 767/1573] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.769608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.772440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:23.777637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaadf1-fa43-4721-b0cb-4ae8382cf5eb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.821154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:23.832769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3dd58-f44d-4850-b6fa-ec90c1bf038f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.836288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.836974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.837257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.837445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.837569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.838240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.838334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.838597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.838994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] PATH_INFO: `/v3/projects/7daaebb175854ac09f1114b1f52dc67f/users/a0d2627bb549465abbcd9b0a96271fc8/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.839845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.850857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 807/1574] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:23.851662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.857076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7daaebb175854ac09f1114b1f52dc67f, user_id=a0d2627bb549465abbcd9b0a96271fc8, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.859966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.866750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424337e-16b6-46fe-8774-b91d48abbc96 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:23.875169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:23.876313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:23.876894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:23.877196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:23.881474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:23.881474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:23.929630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 768/1575] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:23 2022] PUT /identity/v3/projects/7daaebb175854ac09f1114b1f52dc67f/users/a0d2627bb549465abbcd9b0a96271fc8/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:23.930606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:23.954289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 808/1576] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:23.957777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.002497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707351be-42f3-420d-a1ec-9ddf404f93cc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.028366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1ad6e-4ce7-4c51-83f4-27fd947157ee admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.033185 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.033856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.034136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.034406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.035096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.037051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.066416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.067081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.067360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.067638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.068315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.070251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.113165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 809/1577] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.113903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.124417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cec9e-2b89-4926-9a61-da5f710db939 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.129229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.129891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.130171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.130445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.131123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.133133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.160862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 769/1578] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:23 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.161696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.224855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22c022-3515-4371-a416-7b3aa3fdc70d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.230701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.231416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.231703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.231977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.232674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.235873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.246446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 810/1579] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.247774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.257833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6551-0250-47d7-8d41-0811c35529d5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.264312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe090f-0b38-46c1-9421-cd9e8117a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.264312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe090f-0b38-46c1-9421-cd9e8117a0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.264312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe090f-0b38-46c1-9421-cd9e8117a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.264312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe090f-0b38-46c1-9421-cd9e8117a0bc admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.264712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe090f-0b38-46c1-9421-cd9e8117a0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.266652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe090f-0b38-46c1-9421-cd9e8117a0bc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.313325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:24.320175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 770/1580] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.321766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.333608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de65d0d-371e-4f6a-80c6-e4f842e3aede admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.339797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.340693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.341066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.341492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.342080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.343692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.348431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 811/1581] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.349787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.350174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.350462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.356609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 771/1582] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.357318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.367269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6137b-b5a5-45d1-9d4e-627a672da1b4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.372203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.372904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.373666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.373919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.374615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.377181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.382231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] MFA Rules not processed for user `a0d2627bb549465abbcd9b0a96271fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:24.383843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:24.404881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:24.448751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 812/1583] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:24.449640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.460207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794c2c-5cd5-4139-b1b0-b35ccd486bf7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.465369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.466080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 772/1584] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.466265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.466369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.466655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.467002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.467385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.469069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.478412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9009ea-cbfc-4772-8e42-02b1327b6c9a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.480002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 813/1585] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.480929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.484509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.485220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.485498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.485840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.486486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.488409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.490655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb42d95-d83b-497d-9d12-9fbd4913a758 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.495416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.496050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.496331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.496602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.497367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.499118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.510104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 814/1586] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.510954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.520510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1863bbd-8377-4eb9-ad27-639b4a065196 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.525429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.526135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.526949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.527300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.528012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.529651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.540388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 815/1587] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.543703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.551634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5e8fd-860c-43df-bb08-b3b730b29146 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.556183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.556850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.557136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.557411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.558163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.559746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.569922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 816/1588] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.570728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.580803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64345e67-2f87-4378-9149-a26bee7610fa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.585365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.586235 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.586516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.586793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] PATH_INFO: `/v3/projects/a177a86465cb44fb8f56e29e4e5e8e95/users/7dc89117be5f48bb82af8d0f25f251d6/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.598809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 773/1589] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/users => generated 303 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.601194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.603223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a177a86465cb44fb8f56e29e4e5e8e95, user_id=7dc89117be5f48bb82af8d0f25f251d6, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.604253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:17:24.604253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:17:24.604253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:17:24.607246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.611876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91755b0-0c6a-48b5-a91a-c9975cfc7404 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.618993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.619608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.619888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.620181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.620905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.622838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.730690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 817/1590] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:24 2022] PUT /identity/v3/projects/a177a86465cb44fb8f56e29e4e5e8e95/users/7dc89117be5f48bb82af8d0f25f251d6/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:24.731631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.759005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 774/1591] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:24.759005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.811086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d2ef-a654-49cd-8412-539fa854f53d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.827754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fe5a7-5b65-4393-ad7d-2b42da2bad95 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.832455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.833140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.833419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.833688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.834443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.836034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.847598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 775/1592] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.848846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.859307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a79268-2510-4f9f-a9ef-14d16688a6ee admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.864207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.864899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.865189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.865465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.866186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.867786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.876416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.876416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.876416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.876416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.876879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.876879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.877583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:24.878936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 776/1593] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.879737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.886315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 818/1594] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.886980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.890328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b26589-06d4-474a-ae42-907eb144ca60 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.895033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.895689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.895968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.896242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.896569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e40e1-ebe0-44bf-b77c-fb8639a744aa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.896996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.898854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.901591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe980d-b170-431a-86b9-e80cbf0ce564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.902340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe980d-b170-431a-86b9-e80cbf0ce564 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.902642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe980d-b170-431a-86b9-e80cbf0ce564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.902910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe980d-b170-431a-86b9-e80cbf0ce564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.903669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe980d-b170-431a-86b9-e80cbf0ce564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.905291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe980d-b170-431a-86b9-e80cbf0ce564 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.910983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 777/1595] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.911527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.917655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 819/1596] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.919163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.919450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.919724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.924533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f1e4a-dc23-4f36-9785-fcdcf02a0559 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.929930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.930586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.930865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.931145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.931867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.934300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:24.944444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 778/1597] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:24.945267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:24.950999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] MFA Rules not processed for user `7dc89117be5f48bb82af8d0f25f251d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:24.952286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:24.955172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e43f-70c7-43a4-bdfb-06e943f064d4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:24.959873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:24.960574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:24.960892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:24.961168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:24.961849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:24.963813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.019401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 820/1598] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:25.020257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.031932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2e1b0-4a6b-435f-b4cb-2fdf6aba44a2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.037405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.038867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.039133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.039442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] PATH_INFO: `/v3/projects/bf92bdbff72f450ebfcb2d68f14aa523/users/5c77b5c6be6b416da83b907f2bb098ab/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.044973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 779/1599] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:24 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:25.045842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.058278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e467d26-ee7e-453d-8982-7d4af5c946e6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.058946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf92bdbff72f450ebfcb2d68f14aa523, user_id=5c77b5c6be6b416da83b907f2bb098ab, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.061750 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.063594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.064973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.065262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.065606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] PATH_INFO: `/v3/projects/e85a7a21f93d4b45b4154abcb8b059be/users/a13d0223c50e482da3438ec3892dce4f/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.081428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85a7a21f93d4b45b4154abcb8b059be, user_id=a13d0223c50e482da3438ec3892dce4f, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.084097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.133762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 821/1600] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/bf92bdbff72f450ebfcb2d68f14aa523/users/5c77b5c6be6b416da83b907f2bb098ab/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.134669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.162313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 780/1601] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/e85a7a21f93d4b45b4154abcb8b059be/users/a13d0223c50e482da3438ec3892dce4f/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.163221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.177519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:25.209590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55542bcb-bb9d-4d06-9799-d2f443ac3f68 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.230188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f4a74-1b5f-4f9e-bbcd-264a028e030e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.235790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.236704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.237022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.237302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] PATH_INFO: `/v3/projects/381a3ddcc448429baf54ca8ac040f1a5/users/aa41b23451354c6bb2aa12973811a6f8/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.255233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381a3ddcc448429baf54ca8ac040f1a5, user_id=aa41b23451354c6bb2aa12973811a6f8, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.258030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.271838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.272515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.272865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.273110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.274159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.275792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.279011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:25.288451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 822/1602] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:25.289359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.300732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0496a4-d3d9-4b35-96f9-19fb6041f780 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.305607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a09e93-8a5f-4d8e-a207-e60adead8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.306486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a09e93-8a5f-4d8e-a207-e60adead8b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.306762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a09e93-8a5f-4d8e-a207-e60adead8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.307031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a09e93-8a5f-4d8e-a207-e60adead8b60 admin admin] PATH_INFO: `/v3/projects/cc1cd463b5d14d6a83230a44dd616481/users/abaf56950a4842ea9d399e7ee5106a19/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.322625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a09e93-8a5f-4d8e-a207-e60adead8b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1cd463b5d14d6a83230a44dd616481, user_id=abaf56950a4842ea9d399e7ee5106a19, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.325495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a09e93-8a5f-4d8e-a207-e60adead8b60 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.328337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 781/1603] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/381a3ddcc448429baf54ca8ac040f1a5/users/aa41b23451354c6bb2aa12973811a6f8/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.329209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.391255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fb25f-8e21-48f4-b759-aa585221e108 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.396420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.399274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.399274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.399274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.399274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.400332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.411946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 782/1604] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:25.412809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.424196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f66b-252c-4d03-a7ee-b030b1a189ef admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.432379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 823/1605] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/cc1cd463b5d14d6a83230a44dd616481/users/abaf56950a4842ea9d399e7ee5106a19/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.434774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1392-7e95-40a3-87de-83e9c38c6fb1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.435231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1392-7e95-40a3-87de-83e9c38c6fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.435633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1392-7e95-40a3-87de-83e9c38c6fb1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.437510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 824/1606] 10.222.0.71 () {54 vars in 961 bytes} [Wed May 18 14:17:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:17:25.438856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.439242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.439714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.460009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:25.461244 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:25.488654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a03e61-12c1-4900-86f1-8e1b04af73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.489366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a03e61-12c1-4900-86f1-8e1b04af73a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.489647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a03e61-12c1-4900-86f1-8e1b04af73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.489923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a03e61-12c1-4900-86f1-8e1b04af73a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.490652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a03e61-12c1-4900-86f1-8e1b04af73a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.492263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a03e61-12c1-4900-86f1-8e1b04af73a1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.503478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 783/1607] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:25.504779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5c5fc-ade0-43a2-8dd8-7b79ccad56d0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.505091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5c5fc-ade0-43a2-8dd8-7b79ccad56d0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.505363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5c5fc-ade0-43a2-8dd8-7b79ccad56d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.523137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 825/1608] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:25.524465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.534834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27847e98-7e73-4af0-8e43-f421629d2a9c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.538727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-94e5c5fc-ade0-43a2-8dd8-7b79ccad56d0 None None] MFA Rules not processed for user `a13d0223c50e482da3438ec3892dce4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:25.543009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.543157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-94e5c5fc-ade0-43a2-8dd8-7b79ccad56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:25.543253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.543253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.543253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] PATH_INFO: `/v3/projects/909802130f2948bcae9d2445f267a32c/users/b706a6c73a054e6ba4a22d413e1a3d53/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.553142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:25.556639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] RBAC: Authorizing `identity:create_grant(project_id=909802130f2948bcae9d2445f267a32c, user_id=b706a6c73a054e6ba4a22d413e1a3d53, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.559396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.607896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 784/1609] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:25.609312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa67c-61b0-42b5-b159-0dfc2db7865c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.609599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa67c-61b0-42b5-b159-0dfc2db7865c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.609875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa67c-61b0-42b5-b159-0dfc2db7865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.625533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 826/1610] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/909802130f2948bcae9d2445f267a32c/users/b706a6c73a054e6ba4a22d413e1a3d53/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.626348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.630250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ab6aa67c-61b0-42b5-b159-0dfc2db7865c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:25.632523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ab6aa67c-61b0-42b5-b159-0dfc2db7865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:25.694614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 785/1611] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:25.696083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.696363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.696639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.697044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b5a6e-1c30-4ba0-a135-669f6d83ccba admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.703607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a68d4-b8a3-48a0-8975-7617e07a5ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.704957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a68d4-b8a3-48a0-8975-7617e07a5ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.705426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a68d4-b8a3-48a0-8975-7617e07a5ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.705857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a68d4-b8a3-48a0-8975-7617e07a5ae3 admin admin] PATH_INFO: `/v3/projects/0b75482412a840ad83d6f90f256b1282/users/22bd2b3076a84be79dc5c482773ce6ae/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.724097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a68d4-b8a3-48a0-8975-7617e07a5ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b75482412a840ad83d6f90f256b1282, user_id=22bd2b3076a84be79dc5c482773ce6ae, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.725461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] MFA Rules not processed for user `abaf56950a4842ea9d399e7ee5106a19`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:25.726674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:25.727127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a68d4-b8a3-48a0-8975-7617e07a5ae3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.785432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 827/1612] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/0b75482412a840ad83d6f90f256b1282/users/22bd2b3076a84be79dc5c482773ce6ae/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.787102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.787400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.787675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.797308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 786/1613] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:25.798157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.812384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e8c5a-7cbb-462c-96f3-b98563679aea None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.816132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:25.817571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:25.855478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:25.866849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:25.880541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.881514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.881797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.882076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] PATH_INFO: `/v3/projects/cc02bed0df4b47c09c6c541313fc4cd2/users/dbf295a07b5e47ee9aee88b6747dad59/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.900934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 828/1614] 10.222.0.71 () {58 vars in 1058 bytes} [Wed May 18 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:25.902326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.907325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc02bed0df4b47c09c6c541313fc4cd2, user_id=dbf295a07b5e47ee9aee88b6747dad59, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.911897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.961913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0e848-1ce5-4ff3-9b9c-711f6d539c15 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:25.965846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee4be-5ed3-4e75-bfd1-ce31e2a12b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:25.966564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee4be-5ed3-4e75-bfd1-ce31e2a12b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.966841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee4be-5ed3-4e75-bfd1-ce31e2a12b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.967113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee4be-5ed3-4e75-bfd1-ce31e2a12b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:25.970899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 787/1615] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:25 2022] PUT /identity/v3/projects/cc02bed0df4b47c09c6c541313fc4cd2/users/dbf295a07b5e47ee9aee88b6747dad59/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:25.974449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:25.977090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee4be-5ed3-4e75-bfd1-ce31e2a12b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:25.978546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee4be-5ed3-4e75-bfd1-ce31e2a12b80 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:25.988865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 829/1616] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:25.990739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:25.991027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:25.991302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.010401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:26.015582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:26.038367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94669733-33fb-4e04-85aa-950c8da6204b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.042382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e1aa6-3961-48c8-b8fa-b9bdf09fe4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.043042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e1aa6-3961-48c8-b8fa-b9bdf09fe4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.043316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e1aa6-3961-48c8-b8fa-b9bdf09fe4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.043593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e1aa6-3961-48c8-b8fa-b9bdf09fe4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.079550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 830/1617] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:26.080220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.104570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e1aa6-3961-48c8-b8fa-b9bdf09fe4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.106128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e1aa6-3961-48c8-b8fa-b9bdf09fe4e9 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.115621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 788/1618] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:26.121046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.121046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.121046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.154910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88862efb-e5ff-45a1-af08-0e07bc4352f3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.158216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] MFA Rules not processed for user `22bd2b3076a84be79dc5c482773ce6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:26.159498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:26.162605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69f837-1e04-45ea-ad60-67ae62b702aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.163769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69f837-1e04-45ea-ad60-67ae62b702aa service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.164022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69f837-1e04-45ea-ad60-67ae62b702aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.164404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69f837-1e04-45ea-ad60-67ae62b702aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.179347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69f837-1e04-45ea-ad60-67ae62b702aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.181865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69f837-1e04-45ea-ad60-67ae62b702aa service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.199336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 831/1619] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:26.201576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86a5a-393b-450c-9ebe-bb00ed0c03d9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.201942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86a5a-393b-450c-9ebe-bb00ed0c03d9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.203010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86a5a-393b-450c-9ebe-bb00ed0c03d9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.205104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 832/1620] 10.222.0.71 () {54 vars in 961 bytes} [Wed May 18 14:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:17:26.212480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b86a5a-393b-450c-9ebe-bb00ed0c03d9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.238461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:26.261256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 789/1621] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:26.262540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.277357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2540ea-0037-4dbd-9c04-081ec1d169c5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.282888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.283888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.284264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.284641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.285549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.287592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.300194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 790/1622] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:26.304291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.309711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:26.315682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a6bdb-6b6e-4db7-a4e8-ecf1f5ebc07b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.320447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c9809-f1f9-4a1d-82ba-4a8692c79340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.321211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9809-f1f9-4a1d-82ba-4a8692c79340 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.325555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9809-f1f9-4a1d-82ba-4a8692c79340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.325555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9809-f1f9-4a1d-82ba-4a8692c79340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.334287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c9809-f1f9-4a1d-82ba-4a8692c79340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.337605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c9809-f1f9-4a1d-82ba-4a8692c79340 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.340124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b86a5a-393b-450c-9ebe-bb00ed0c03d9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.351426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.354169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.354169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.354169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.355641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 791/1623] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:26.357948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.358380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.359079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.389462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:26.391623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:26.418188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 792/1624] 10.222.0.71 () {58 vars in 1058 bytes} [Wed May 18 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:26.422098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.433290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235501c-8c63-478c-bbcf-e10b55624c18 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.433787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.436556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.440070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3d68a-1c82-4ed5-952a-27b8fdde851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.441216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d68a-1c82-4ed5-952a-27b8fdde851d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.444259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d68a-1c82-4ed5-952a-27b8fdde851d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.444527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d68a-1c82-4ed5-952a-27b8fdde851d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.445590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3d68a-1c82-4ed5-952a-27b8fdde851d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.449494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3d68a-1c82-4ed5-952a-27b8fdde851d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.465692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 833/1625] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:26.467430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.486422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3733f-6a5f-4b1d-a39c-f1c3d0562c10 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.493084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.494654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.496303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.496303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] PATH_INFO: `/v3/projects/cc02bed0df4b47c09c6c541313fc4cd2/users/dbf295a07b5e47ee9aee88b6747dad59/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.498305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc02bed0df4b47c09c6c541313fc4cd2, user_id=dbf295a07b5e47ee9aee88b6747dad59, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.502879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.516099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 834/1626] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:26 2022] PUT /identity/v3/projects/cc02bed0df4b47c09c6c541313fc4cd2/users/dbf295a07b5e47ee9aee88b6747dad59/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:26.517276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.558177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 793/1627] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:26 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:26.561857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.562402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.563061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.617146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] MFA Rules not processed for user `dbf295a07b5e47ee9aee88b6747dad59`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:26.618904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:26.671417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159fcdf-12b1-495d-87ff-deef759cffe1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.720218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:26.752722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 794/1628] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:26.754343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.764461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f2eee-4bb3-4687-a829-1563ffca5a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.765942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2eee-4bb3-4687-a829-1563ffca5a1a service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.766314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2eee-4bb3-4687-a829-1563ffca5a1a service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.767384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2eee-4bb3-4687-a829-1563ffca5a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.848240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f2eee-4bb3-4687-a829-1563ffca5a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.850119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f2eee-4bb3-4687-a829-1563ffca5a1a service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.875914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ebe88-fc5c-43f7-bbef-f5c2e3302bb9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:26.881093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b59ba-5241-4455-a618-5edf89bcac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:26.881837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b59ba-5241-4455-a618-5edf89bcac9c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.882119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b59ba-5241-4455-a618-5edf89bcac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.882448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b59ba-5241-4455-a618-5edf89bcac9c admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.883048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 835/1629] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:26.883165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b59ba-5241-4455-a618-5edf89bcac9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:26.885283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b59ba-5241-4455-a618-5edf89bcac9c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:26.887175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e618-79a2-48be-b825-4d87333317ce None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.892460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e618-79a2-48be-b825-4d87333317ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.892460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e618-79a2-48be-b825-4d87333317ce None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:26.894314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 836/1630] 10.222.0.71 () {54 vars in 912 bytes} [Wed May 18 14:17:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:17:26.895369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e618-79a2-48be-b825-4d87333317ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:26.986046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 795/1631] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:26 2022] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:26.992492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:26.992820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:26.993120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.031499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e618-79a2-48be-b825-4d87333317ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.043090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.044173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.045920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.045920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.046928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:27.050501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:27.059584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.061533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.074739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 837/1632] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:27.075859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:27.087852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9b6c0-7280-4173-9147-f6fa9199813d service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.089462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 796/1633] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:27.095417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0777b2-41f3-49c2-b569-fa92c9927603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.096205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0777b2-41f3-49c2-b569-fa92c9927603 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.096658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0777b2-41f3-49c2-b569-fa92c9927603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.097144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0777b2-41f3-49c2-b569-fa92c9927603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.098557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0777b2-41f3-49c2-b569-fa92c9927603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.101854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0777b2-41f3-49c2-b569-fa92c9927603 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.123752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 838/1634] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:27.127956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:27.142027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e89ff-f10c-4c91-9169-9b71e73650d1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.149245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.149997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.150456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.150897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] PATH_INFO: `/v3/projects/2f6fdd2123cb4b449bec99d40431a7fd/users/c61250d52abb4a47a5591d6e734e373b/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.172153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6fdd2123cb4b449bec99d40431a7fd, user_id=c61250d52abb4a47a5591d6e734e373b, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.174926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.272106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85199-b6b5-4db3-81d8-ca793822f5c6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.272468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85199-b6b5-4db3-81d8-ca793822f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.272839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f85199-b6b5-4db3-81d8-ca793822f5c6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.277014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 839/1635] 10.222.0.71 () {54 vars in 912 bytes} [Wed May 18 14:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:17:27.283035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.283452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.283861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.298483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 797/1636] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:27 2022] PUT /identity/v3/projects/2f6fdd2123cb4b449bec99d40431a7fd/users/c61250d52abb4a47a5591d6e734e373b/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:27.303174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:27.310833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:27.320001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:27.321593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:27.410061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:27.425541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 840/1637] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:17:27.426660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:27.463887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac394cb-35a1-47f8-8a8e-bc161e20b3d6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.471928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.473159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.474391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.474391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.475731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.479863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.504738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c78ba-4c8e-4fcc-833e-069fac92bae6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.506033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 798/1638] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:17:27.510269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:27.515280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f36b8-f165-47e5-bec5-0e6dc6a24323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.516091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f36b8-f165-47e5-bec5-0e6dc6a24323 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.516487 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f36b8-f165-47e5-bec5-0e6dc6a24323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.517430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f36b8-f165-47e5-bec5-0e6dc6a24323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.537506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f36b8-f165-47e5-bec5-0e6dc6a24323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.540848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f36b8-f165-47e5-bec5-0e6dc6a24323 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.556518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600cf5-7c3d-4d90-ac9f-930e2d366b38 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.572572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 841/1639] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:27.601896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.601896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.601896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.601896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] PATH_INFO: `/v3/projects/2f6fdd2123cb4b449bec99d40431a7fd/users/c61250d52abb4a47a5591d6e734e373b/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.821757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6fdd2123cb4b449bec99d40431a7fd, user_id=c61250d52abb4a47a5591d6e734e373b, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.821757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.821757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 799/1640] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:27 2022] PUT /identity/v3/projects/2f6fdd2123cb4b449bec99d40431a7fd/users/c61250d52abb4a47a5591d6e734e373b/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:17:27.825348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.825348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.825348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.825348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] MFA Rules not processed for user `c61250d52abb4a47a5591d6e734e373b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:27.825348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:27.828347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:27.837498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 842/1641] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:27.854302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afae066-34e5-4522-9586-46b1f70c4c98 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:27.859550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5012e2-c6f2-41ea-b3e9-cb5257d1d7a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:27.860385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5012e2-c6f2-41ea-b3e9-cb5257d1d7a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:27.860823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5012e2-c6f2-41ea-b3e9-cb5257d1d7a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:27.862583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5012e2-c6f2-41ea-b3e9-cb5257d1d7a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:27.979767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5012e2-c6f2-41ea-b3e9-cb5257d1d7a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:27.981290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5012e2-c6f2-41ea-b3e9-cb5257d1d7a8 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:27.993916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 800/1642] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:28.045800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:28.056982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c01f22-ec67-4419-9e21-c3c0ab48a412 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:28.075140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:28.075827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:28.076091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:28.076368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:28.164543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:28.166316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:28.177649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 843/1643] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:28.507957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd14f0-b03e-4b47-a0fb-c429b622bfcf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:28.508489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd14f0-b03e-4b47-a0fb-c429b622bfcf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:28.508489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd14f0-b03e-4b47-a0fb-c429b622bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:28.540654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5edd14f0-b03e-4b47-a0fb-c429b622bfcf None None] MFA Rules not processed for user `aa41b23451354c6bb2aa12973811a6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:28.542473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5edd14f0-b03e-4b47-a0fb-c429b622bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:28.564659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:28.634042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:28.641234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 801/1644] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:28.654380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500618-181d-4383-bace-f4a49d8031e0 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:28.655192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:28.655775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:28.656721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:28.658893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:28.659604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:28.659885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:28.660301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:28.672576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:28.676045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:28.685402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] MFA Rules not processed for user `aa41b23451354c6bb2aa12973811a6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:28.686790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:28.699500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 802/1645] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:28.699677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 844/1646] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:28.782613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:28.803275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13cc75-3dcd-4ee6-87ee-fa8f5bfb7bc7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:28.818170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:28.818905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:28.819193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:28.819471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:28.844269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:28.861552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:28.886650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 803/1647] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:29.070963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:29.079943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:29.198985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:29.262667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06120-af06-4c73-b8ae-1832c8225b31 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:29.275550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:29.277104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:29.277387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:29.277665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] PATH_INFO: `/v3/users/abaf56950a4842ea9d399e7ee5106a19` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:29.284390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abaf56950a4842ea9d399e7ee5106a19)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:29.286550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: WARNING py.warnings [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:17:29.286550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: warnings.warn(msg) May 18 14:17:29.286550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: May 18 14:17:29.288882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:29.339008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08e0a4-9a62-4886-9a1c-0d9ac9a1420b service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:29.345761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:29.348695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:29.349003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:29.351476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] PATH_INFO: `/v3/users/22bd2b3076a84be79dc5c482773ce6ae` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:29.357076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bd2b3076a84be79dc5c482773ce6ae)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:29.359812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:29.577601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abaf56950a4842ea9d399e7ee5106a19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.626910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bd2b3076a84be79dc5c482773ce6ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.627785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bd2b3076a84be79dc5c482773ce6ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.628391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bd2b3076a84be79dc5c482773ce6ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.690610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abaf56950a4842ea9d399e7ee5106a19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.692122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abaf56950a4842ea9d399e7ee5106a19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.708122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abaf56950a4842ea9d399e7ee5106a19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.709089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5852c88f-8904-4963-8af3-7ddac4ccd3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abaf56950a4842ea9d399e7ee5106a19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.740396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 845/1648] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:29 2022] DELETE /identity/v3/users/abaf56950a4842ea9d399e7ee5106a19 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:29.742243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b595-dff9-435d-b9c2-9cc4b20c7471 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:29.742605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b595-dff9-435d-b9c2-9cc4b20c7471 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:29.742966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0b595-dff9-435d-b9c2-9cc4b20c7471 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:29.744373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 846/1649] 10.222.0.71 () {54 vars in 912 bytes} [Wed May 18 14:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:17:29.746662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692dfa-b5de-430b-a895-6ff1295a0659 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:29.746943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692dfa-b5de-430b-a895-6ff1295a0659 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:29.747219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692dfa-b5de-430b-a895-6ff1295a0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:29.764575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bd2b3076a84be79dc5c482773ce6ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.767356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2d692dfa-b5de-430b-a895-6ff1295a0659 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:29.768992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2d692dfa-b5de-430b-a895-6ff1295a0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:29.782498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-82cbc201-0b27-4d9e-a2fe-b8e6b91d4c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bd2b3076a84be79dc5c482773ce6ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:29.805257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 804/1650] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:29 2022] DELETE /identity/v3/users/22bd2b3076a84be79dc5c482773ce6ae => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:29.805257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:29.805257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:29.805257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:29.843007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:29.852516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:29.853906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:29.880546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 847/1651] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:29.881978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:29.882269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:29.882548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:29.906416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:29.907823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:29.951130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 805/1652] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:29.952561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:29.974139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:30.001040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:30.072352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4455f-f4b8-49cc-8086-46c080a61140 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:30.095772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2286a9-de98-45cd-9e47-40136f434763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:30.099812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2286a9-de98-45cd-9e47-40136f434763 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:30.100346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2286a9-de98-45cd-9e47-40136f434763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:30.100894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2286a9-de98-45cd-9e47-40136f434763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:30.162311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 848/1653] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:30.178006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:30.241264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039cfa1-64a9-4e5f-aa7e-7553420e0509 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:30.250592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:30.251758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:30.252209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:30.252679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:30.268374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:30.271813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:30.291944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 849/1654] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:30.293167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:30.352031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564bb5-64e5-4037-8fa7-2eb96e13e880 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:30.366705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2286a9-de98-45cd-9e47-40136f434763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:30.375053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ba942-241c-4b78-9191-b2a783cfedcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:30.375787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ba942-241c-4b78-9191-b2a783cfedcc service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:30.376135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ba942-241c-4b78-9191-b2a783cfedcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:30.376504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ba942-241c-4b78-9191-b2a783cfedcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:30.379290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2286a9-de98-45cd-9e47-40136f434763 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:30.412603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ba942-241c-4b78-9191-b2a783cfedcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:30.414413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ba942-241c-4b78-9191-b2a783cfedcc service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:30.417109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 806/1655] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:30.462793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 850/1656] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:31.740266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bb762-1294-41d7-87bb-9af7c8685b7c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:31.740761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bb762-1294-41d7-87bb-9af7c8685b7c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:31.740925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bb762-1294-41d7-87bb-9af7c8685b7c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:31.743271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 807/1657] 10.222.0.71 () {54 vars in 960 bytes} [Wed May 18 14:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:17:31.756332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:31.756933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:31.757076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:31.788394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bb762-1294-41d7-87bb-9af7c8685b7c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:31.793213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] MFA Rules not processed for user `6d5153b7c1af4b7285ada5dba9316416`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:31.793656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-369bb762-1294-41d7-87bb-9af7c8685b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:31.797662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:31.849479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bb762-1294-41d7-87bb-9af7c8685b7c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:31.871286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:31.872454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:31.872735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:31.873034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] PATH_INFO: `/v3/projects/cc1cd463b5d14d6a83230a44dd616481` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:31.878917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1cd463b5d14d6a83230a44dd616481)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:31.879954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: WARNING py.warnings [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 14:17:31.879954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: warnings.warn(msg) May 18 14:17:31.879954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: May 18 14:17:31.881552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:31.971646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 851/1658] 10.222.0.71 () {58 vars in 1057 bytes} [Wed May 18 14:17:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:31.983011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:32.007480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204de15-b89f-4d21-9ab7-1cb48f7432b9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:32.015241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:32.016340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:32.016836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:32.017359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:32.021153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:32.047630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:32.047630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440e3e-39da-43c8-a3f8-aee3071ecded service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:32.068922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 852/1659] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:32.124682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1cd463b5d14d6a83230a44dd616481', 'request_id': 'req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:32.150280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1cd463b5d14d6a83230a44dd616481', 'request_id': 'req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:32.189536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1cd463b5d14d6a83230a44dd616481', 'request_id': 'req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:32.296463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] The token cache is being invalidate because project cc1cd463b5d14d6a83230a44dd616481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:32.296884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:32.298176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c0d1576-d73e-43b9-96eb-21a4bebeceeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:32.300442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 808/1660] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:31 2022] DELETE /identity/v3/projects/cc1cd463b5d14d6a83230a44dd616481 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:32.305687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:32.306227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:32.306784 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:32.340397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:32.346768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:32.485214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 853/1661] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:32.492984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:32.493275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:32.493553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:32.695082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:32.696764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:32.709291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 809/1662] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:32.714423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:32.727240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142aa97a-adb6-4cbe-8bd7-7da0fcb13a24 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:32.737458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:32.737458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:32.737458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:32.737458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:32.738745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:32.739244 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:32.741127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:32.798662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 854/1663] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:32.803630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:32.813131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:32.822855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:32.827609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990be7-a369-4699-ac6b-989186fbcb12 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:32.842561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:32.845413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:32.850642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:32.851387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:32.853567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:32.860909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad638cd-f887-4448-a47a-1110185469f1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:32.861732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:32.886667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:32.887787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:32.888130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:32.888525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] PATH_INFO: `/v3/projects/0b75482412a840ad83d6f90f256b1282` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:32.890203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b75482412a840ad83d6f90f256b1282)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:32.894051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:32.899544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:33.035830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 810/1664] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:32 2022] POST /identity/v3/projects => generated 403 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:33.042689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:33.059779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:33.153791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b75482412a840ad83d6f90f256b1282', 'request_id': 'req-657e1415-e89c-40f3-8bfe-54ab22842f82'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.247431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee273b-2416-4dc2-8ee7-c62d857ba7b7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:33.304701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b75482412a840ad83d6f90f256b1282', 'request_id': 'req-657e1415-e89c-40f3-8bfe-54ab22842f82'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.317582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b75482412a840ad83d6f90f256b1282', 'request_id': 'req-657e1415-e89c-40f3-8bfe-54ab22842f82'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.356396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] The token cache is being invalidate because project 0b75482412a840ad83d6f90f256b1282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:33.356696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.359357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.365432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 855/1665] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:32 2022] DELETE /identity/v3/projects/0b75482412a840ad83d6f90f256b1282 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:33.371047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:33.385793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:33.387290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:33.387634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:33.388201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:33.389065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:33.392263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:33.392741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:33.418948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e1415-e89c-40f3-8bfe-54ab22842f82 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:33.438626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:33.439782 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:33.440215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:33.440664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] PATH_INFO: `/v3/users/c61250d52abb4a47a5591d6e734e373b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:33.444285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61250d52abb4a47a5591d6e734e373b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:33.446513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:33.545325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 811/1666] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:33 2022] POST /identity/v3/users => generated 302 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:17:33.548114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:33.551025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:33.576297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ac94e-b7ab-4499-bd8d-0dc20f7ccf9d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:33.590298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:33.591239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:33.591669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:33.592164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:33.594202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:33.603378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:33.623226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 812/1667] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:33.633621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:33.649311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729bb4-c052-4f8e-8c65-1430e325218c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:33.661631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:33.662626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:33.663049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:33.663484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:33.664371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:33.666477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:33.679952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 813/1668] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:17:33.696623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:33.712838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61250d52abb4a47a5591d6e734e373b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.716271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba376d3-3057-4284-a8a7-5bd9cb5562b3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:33.723130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1f96f-1f99-4bf8-aa82-b84f65ed88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:33.724097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f96f-1f99-4bf8-aa82-b84f65ed88e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:33.724299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f96f-1f99-4bf8-aa82-b84f65ed88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:33.724569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1f96f-1f99-4bf8-aa82-b84f65ed88e8 admin admin] PATH_INFO: `/v3/projects/b097dd9a53ed449ab0dba2d0324e8f94/users/40fef6793ad746778b0627662d5b3025/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:33.742615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1f96f-1f99-4bf8-aa82-b84f65ed88e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b097dd9a53ed449ab0dba2d0324e8f94, user_id=40fef6793ad746778b0627662d5b3025, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:33.745774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1f96f-1f99-4bf8-aa82-b84f65ed88e8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:33.826657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61250d52abb4a47a5591d6e734e373b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.828017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61250d52abb4a47a5591d6e734e373b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.838284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61250d52abb4a47a5591d6e734e373b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.841386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61250d52abb4a47a5591d6e734e373b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:33.867011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 814/1669] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:33 2022] PUT /identity/v3/projects/b097dd9a53ed449ab0dba2d0324e8f94/users/40fef6793ad746778b0627662d5b3025/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:33.872994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:33.873663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:33.874103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:33.907175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 856/1670] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:33 2022] DELETE /identity/v3/users/c61250d52abb4a47a5591d6e734e373b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:33.924771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:33.928410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:34.073881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 815/1671] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:34.114810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:34.116260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:34.242711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9a8f-7593-4c27-b890-eadb3680f952 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:34.249555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e840731-e5f4-44d3-94b9-6e586c83b9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:34.250231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e840731-e5f4-44d3-94b9-6e586c83b9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:34.250672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e840731-e5f4-44d3-94b9-6e586c83b9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:34.251088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e840731-e5f4-44d3-94b9-6e586c83b9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:34.280011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e840731-e5f4-44d3-94b9-6e586c83b9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:34.284201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e840731-e5f4-44d3-94b9-6e586c83b9e9 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:34.310294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 857/1672] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:17:34.433645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:34.810080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:34.811867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:34.843704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d5be8-ae9a-444a-b06b-8d55a6fa2c1c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:34.858580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:34.859711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:34.860131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:34.860708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] PATH_INFO: `/v3/projects/2f6fdd2123cb4b449bec99d40431a7fd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:34.862229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6fdd2123cb4b449bec99d40431a7fd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:34.864595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:35.036593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6fdd2123cb4b449bec99d40431a7fd', 'request_id': 'req-ab2b03e8-034e-4063-ad82-f08730b68227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:35.053086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6fdd2123cb4b449bec99d40431a7fd', 'request_id': 'req-ab2b03e8-034e-4063-ad82-f08730b68227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:35.071909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6fdd2123cb4b449bec99d40431a7fd', 'request_id': 'req-ab2b03e8-034e-4063-ad82-f08730b68227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:35.209381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] The token cache is being invalidate because project 2f6fdd2123cb4b449bec99d40431a7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:35.210082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:35.211671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ab2b03e8-034e-4063-ad82-f08730b68227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:35.215926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 816/1673] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:34 2022] DELETE /identity/v3/projects/2f6fdd2123cb4b449bec99d40431a7fd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:35.221083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:35.222335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:35.222742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:35.243065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:35.250501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:35.252768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:35.434103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 858/1674] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:35.442237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:35.442519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:35.442973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:35.514952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:35.525784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:35.557983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 817/1675] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:35.562574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:35.583045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb6b4-34af-4e5c-a2ce-b3b1a7fa3508 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:35.602461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:35.608321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:35.609382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:35.610553 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:35.612866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:35.615253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:35.618029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:35.654879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 859/1676] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:35.659357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:35.681502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c7bef-64c9-46eb-844e-5c5fc6f74fb0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:35.694557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:35.695323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:35.695652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:35.696026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:35.698153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:35.704914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:35.869196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 818/1677] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:35 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:35.873964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:35.893183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daf6aa-af84-4867-8607-9462f9cc59a2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:36.040622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:36.042165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:36.044798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:36.046832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:36.049732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:36.055712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:36.160817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 860/1678] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:35 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:36.165219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:36.204434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277d47f-342f-48e3-bf37-5fe335750d78 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:36.215219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:36.215915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:36.216195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:36.216635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:36.217418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:36.219052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:36.267732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 819/1679] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:36.271517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:36.290975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83b81-35dc-4725-a7f5-782e60bb37dc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:36.324472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc7e82-b0c6-44c7-b562-e8c0809f4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:36.325328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7e82-b0c6-44c7-b562-e8c0809f4f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:36.332594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7e82-b0c6-44c7-b562-e8c0809f4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:36.332594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc7e82-b0c6-44c7-b562-e8c0809f4f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:36.332594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc7e82-b0c6-44c7-b562-e8c0809f4f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:36.344533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc7e82-b0c6-44c7-b562-e8c0809f4f8f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:36.382028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:36.382938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 861/1680] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:36.399412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1bd00-e5e4-4550-943e-9b2a9c399695 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:36.415645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:36.417278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:36.417440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:36.417686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] PATH_INFO: `/v3/projects/97793358b2004a3fa94dec24134b1f1c/users/614732a055b646f1b748928937b5d8a9/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:36.494317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97793358b2004a3fa94dec24134b1f1c, user_id=614732a055b646f1b748928937b5d8a9, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:36.504033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:36.614849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ffdc9-52f9-4f6c-bc9d-4b4b7c2ab139 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:36.615138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ffdc9-52f9-4f6c-bc9d-4b4b7c2ab139 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:36.615466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ffdc9-52f9-4f6c-bc9d-4b4b7c2ab139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:36.618935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 820/1681] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:36 2022] PUT /identity/v3/projects/97793358b2004a3fa94dec24134b1f1c/users/614732a055b646f1b748928937b5d8a9/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:36.714389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:36.717505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:36.723256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e90ffdc9-52f9-4f6c-bc9d-4b4b7c2ab139 None None] MFA Rules not processed for user `614732a055b646f1b748928937b5d8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:36.730287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e90ffdc9-52f9-4f6c-bc9d-4b4b7c2ab139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:36.993365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23b63-7ff9-4c5c-9e21-649523eb7197 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:37.026765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 862/1682] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:37.031429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:37.031739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:37.032026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:37.039577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:37.048598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:37.053102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:37.054066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:37.054524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] PATH_INFO: `/v3/users/a0d2627bb549465abbcd9b0a96271fc8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:37.060824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d2627bb549465abbcd9b0a96271fc8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:37.064578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:37.085857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] MFA Rules not processed for user `5c77b5c6be6b416da83b907f2bb098ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:37.087959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:37.092701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:37.183763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 863/1683] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:37.184732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:37.222686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47eda5-61f0-4e54-ab3b-e9e4ee3cec5a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:37.236307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92c63-e12e-4e13-a6be-410cd46f2420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:37.237056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92c63-e12e-4e13-a6be-410cd46f2420 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:37.237338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92c63-e12e-4e13-a6be-410cd46f2420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:37.237612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92c63-e12e-4e13-a6be-410cd46f2420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:37.243462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92c63-e12e-4e13-a6be-410cd46f2420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:37.246205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92c63-e12e-4e13-a6be-410cd46f2420 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:37.389753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 864/1684] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:37 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:37.414273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:37.416234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:37.418071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:37.428122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d2627bb549465abbcd9b0a96271fc8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:37.430693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d2627bb549465abbcd9b0a96271fc8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:37.431593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d2627bb549465abbcd9b0a96271fc8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:37.475609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] MFA Rules not processed for user `5c77b5c6be6b416da83b907f2bb098ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:37.477331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:37.518355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d2627bb549465abbcd9b0a96271fc8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:37.549483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2309f22b-c829-43ca-a7da-99483ac0b7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d2627bb549465abbcd9b0a96271fc8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:37.581923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 865/1685] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:37.585026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:37.587468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:37.597520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 821/1686] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:36 2022] DELETE /identity/v3/users/a0d2627bb549465abbcd9b0a96271fc8 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:17:37.599395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:37.599685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:37.600362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:37.699040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:37.702800 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:37.779992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7ede9-8bb5-412e-aea5-9e9281010236 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:37.842080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:37.907374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 822/1687] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:37.908472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:37.914845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:37.954602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:37.955303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:37.955593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:37.955871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:37.956574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:37.966165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:38.079539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac877015-dfa7-422c-bec9-1b26eb3ebb94 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:38.096729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:38.097637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:38.098055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:38.098934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:38.105818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:38.140350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 866/1688] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:37 2022] POST /identity/v3/users => generated 297 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:38.141461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:38.146558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:38.190183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:38.273125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:38.275041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743af99-1b10-46b8-8065-54fa08b8f688 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:38.319262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 823/1689] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:38.320626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:38.320939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:38.322357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:38.329006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697162d-48e7-4e6f-8d74-70e6cdcfa00d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:38.343854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:38.345025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:38.345447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:38.346010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:38.368253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:38.372954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:38.394145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:38.397349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:38.426069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 867/1690] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:38.427141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:38.481249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc91ae1-2f62-4cab-aa14-f8fd2d910360 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:38.499856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:38.500639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:38.501123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:38.501465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:38.502285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:38.506601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:38.532256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 868/1691] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:38.536334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:38.563550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74de6a-ca5b-4d6c-ba9b-ca42bb4f92da admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:38.579223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:38.581828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:38.581828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:38.583130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] PATH_INFO: `/v3/projects/437731c22c7a48299fd4f11885a9da33/users/8919a1ceb4f84b7d88cfc6a317cba02b/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:38.591120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 824/1692] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:38.636219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=437731c22c7a48299fd4f11885a9da33, user_id=8919a1ceb4f84b7d88cfc6a317cba02b, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:38.646860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:38.753130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 869/1693] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:38 2022] PUT /identity/v3/projects/437731c22c7a48299fd4f11885a9da33/users/8919a1ceb4f84b7d88cfc6a317cba02b/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:38.754519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:38.780596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f6f6f-842c-427a-8afe-517af5ee3dff None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:38.986244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7661d-9c4d-4abb-9d42-35b72ee51172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:38.987287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7661d-9c4d-4abb-9d42-35b72ee51172 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:38.987734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7661d-9c4d-4abb-9d42-35b72ee51172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:38.988324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7661d-9c4d-4abb-9d42-35b72ee51172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:38.989414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7661d-9c4d-4abb-9d42-35b72ee51172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:38.993175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7661d-9c4d-4abb-9d42-35b72ee51172 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:39.030873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 825/1694] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:39.032046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:39.049999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9daa22-74fb-4cf8-a0bb-cd881b963047 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:39.055966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f68c34-4152-451b-8169-fe91c78ac7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:39.057245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68c34-4152-451b-8169-fe91c78ac7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:39.057952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68c34-4152-451b-8169-fe91c78ac7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:39.058399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68c34-4152-451b-8169-fe91c78ac7f2 admin admin] PATH_INFO: `/v3/projects/437731c22c7a48299fd4f11885a9da33/users/8919a1ceb4f84b7d88cfc6a317cba02b/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:39.062057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f68c34-4152-451b-8169-fe91c78ac7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=437731c22c7a48299fd4f11885a9da33, user_id=8919a1ceb4f84b7d88cfc6a317cba02b, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:39.065448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f68c34-4152-451b-8169-fe91c78ac7f2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:39.079637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 870/1695] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:39 2022] PUT /identity/v3/projects/437731c22c7a48299fd4f11885a9da33/users/8919a1ceb4f84b7d88cfc6a317cba02b/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:39.094157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:39.094650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:39.095073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:39.128020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:39.128353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:39.133847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:39.218556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] MFA Rules not processed for user `8919a1ceb4f84b7d88cfc6a317cba02b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:39.225012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:39.241516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] MFA Rules not processed for user `40fef6793ad746778b0627662d5b3025`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:39.247663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:39.456821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:39.482690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 871/1696] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:39.483716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:39.484027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:39.490944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:39.522756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 826/1697] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:39.522756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:39.526750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:39.685640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034066e-2382-4873-8bd4-9eb1e0d81d85 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:39.691262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88790591-6e1c-40a6-87a5-e38807e806f3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:39.707177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:39.707991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:39.708384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:39.708767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:39.712121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:39.717629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:39.717629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:39.717629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] PATH_INFO: `/v3/users/7dc89117be5f48bb82af8d0f25f251d6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:39.718891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc89117be5f48bb82af8d0f25f251d6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:39.722614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:39.829597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:39.832408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:39.861533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 872/1698] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:17:39.862778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:39.866984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:39.974210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a74c5-d2fb-480c-b84c-7c44f2630da2 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:40.006894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:40.007848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:40.008134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:40.008414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:40.009151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:40.017494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:40.075934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc89117be5f48bb82af8d0f25f251d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:40.082640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc89117be5f48bb82af8d0f25f251d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:40.086491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc89117be5f48bb82af8d0f25f251d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:40.215800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 873/1699] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:39 2022] POST /identity/v3/projects => generated 403 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:40.223154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:40.226329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:40.252266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc89117be5f48bb82af8d0f25f251d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:40.305480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc89117be5f48bb82af8d0f25f251d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:40.390464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 827/1700] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:39 2022] DELETE /identity/v3/users/7dc89117be5f48bb82af8d0f25f251d6 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:40.392529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:40.395279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:40.524216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ccaeb-365b-4bf4-8bce-e8dce8999389 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:40.668891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:40.704463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1a772-9cdf-4a01-97b0-89dbf8e94e3b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:40.722457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfb532-7c0a-44e0-87d1-283ebb175f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:40.726315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfb532-7c0a-44e0-87d1-283ebb175f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:40.726866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfb532-7c0a-44e0-87d1-283ebb175f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:40.729362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfb532-7c0a-44e0-87d1-283ebb175f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:40.730332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfb532-7c0a-44e0-87d1-283ebb175f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:40.741533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfb532-7c0a-44e0-87d1-283ebb175f14 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:40.799248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:40.799940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:40.800229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:40.800552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:40.814054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:40.864671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 828/1701] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:40 2022] POST /identity/v3/users => generated 308 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:40.866722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33111f0-e938-47f0-884c-98251a681342 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:40.867013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33111f0-e938-47f0-884c-98251a681342 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:40.867366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33111f0-e938-47f0-884c-98251a681342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:40.887002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:40.919659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d33111f0-e938-47f0-884c-98251a681342 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:40.922782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d33111f0-e938-47f0-884c-98251a681342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:40.943881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 829/1702] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:40.950312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532a56-742c-474e-a14f-e80e00f62a8f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:40.950909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532a56-742c-474e-a14f-e80e00f62a8f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:40.951470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532a56-742c-474e-a14f-e80e00f62a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:40.988620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-51532a56-742c-474e-a14f-e80e00f62a8f None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:40.992707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-51532a56-742c-474e-a14f-e80e00f62a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:41.196182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:41.198770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:41.240377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 830/1703] 10.222.0.72 () {58 vars in 1015 bytes} [Wed May 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:41.240377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:41.248120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:41.248801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:41.269789 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 874/1704] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 1051 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:41.270785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:41.324464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810f014-1d87-481a-9fff-d434bcc93b22 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:41.330804 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] MFA Rules not processed for user `5c77b5c6be6b416da83b907f2bb098ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:41.331715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:41.333064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:41.337775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:41.339720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:41.340845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:41.341164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:41.345255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:41.392390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 875/1705] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:41.392390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:41.401891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:41.454580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0de38-6fd5-456a-94dc-9b8fce24d30b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:41.481136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:41.481811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:41.482101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:41.482374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:41.511121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 831/1706] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:41.511121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:41.524735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:41.527739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:41.537559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:41.583282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40bb4b-f83b-4ec8-b4dc-74e7fa824215 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:41.610612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 876/1707] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:41.618532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:41.632742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:41.633691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:41.633980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:41.634533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] PATH_INFO: `/v3/projects/7daaebb175854ac09f1114b1f52dc67f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:41.637261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7daaebb175854ac09f1114b1f52dc67f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:41.639595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:41.661149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c4db1-c553-4c28-a392-39311cbe8584 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:41.679978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:41.686231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:41.686782 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:41.687856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:41.720133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:41.724822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:41.749845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 877/1708] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:41.750763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:41.795817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a388589-e73f-4fdc-a2c8-11d1413ba797 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:41.802142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:41.803389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:41.806917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:41.807415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] PATH_INFO: `/v3/projects/55f6aed2e6c3486f8af4b3a3327c81ec/users/0b67799c084645a8931ead71981bfbbe/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:41.834018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f6aed2e6c3486f8af4b3a3327c81ec, user_id=0b67799c084645a8931ead71981bfbbe, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:41.840168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:41.996138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 878/1709] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:41 2022] PUT /identity/v3/projects/55f6aed2e6c3486f8af4b3a3327c81ec/users/0b67799c084645a8931ead71981bfbbe/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:41.997544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:42.013019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7daaebb175854ac09f1114b1f52dc67f', 'request_id': 'req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:42.035732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7daaebb175854ac09f1114b1f52dc67f', 'request_id': 'req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:42.061003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7daaebb175854ac09f1114b1f52dc67f', 'request_id': 'req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:42.169090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] The token cache is being invalidate because project 7daaebb175854ac09f1114b1f52dc67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:42.169692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:42.172830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:42.181577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 832/1710] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:41 2022] DELETE /identity/v3/projects/7daaebb175854ac09f1114b1f52dc67f => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:42.181577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:42.183985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:42.199256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff04bf-631f-43a2-8453-78b5a468a898 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:42.285779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:42.390960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:42.424622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:42.424891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca976f-b277-4ddd-95a2-bfee1d2010ab admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:42.425218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:42.428348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:42.428755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:42.428979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:42.429605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:42.429720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:42.430161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:42.430449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:42.431280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:42.433889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:42.458365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 879/1711] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:42.459724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:42.465142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:42.498572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624269c-865a-4931-8d67-ec72f29a769b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:42.512980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:42.513958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:42.522704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:42.523204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] PATH_INFO: `/v3/users/dbf295a07b5e47ee9aee88b6747dad59` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:42.524778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf295a07b5e47ee9aee88b6747dad59)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:42.538220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:42.690743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:42.692234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:42.743354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 833/1712] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:42.744208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:42.746015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:42.781999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b2f0-b14c-4a48-a762-12eaddb47bf0 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:42.806402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e392b-9211-44e1-b765-64463c43078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:42.807996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e392b-9211-44e1-b765-64463c43078b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:42.808347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e392b-9211-44e1-b765-64463c43078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:42.808636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e392b-9211-44e1-b765-64463c43078b admin admin] PATH_INFO: `/v3/projects/55f6aed2e6c3486f8af4b3a3327c81ec/users/0b67799c084645a8931ead71981bfbbe/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:42.822487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e392b-9211-44e1-b765-64463c43078b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f6aed2e6c3486f8af4b3a3327c81ec, user_id=0b67799c084645a8931ead71981bfbbe, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:42.826031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e392b-9211-44e1-b765-64463c43078b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:42.860242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 834/1713] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:42 2022] PUT /identity/v3/projects/55f6aed2e6c3486f8af4b3a3327c81ec/users/0b67799c084645a8931ead71981bfbbe/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:42.908843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf295a07b5e47ee9aee88b6747dad59'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:43.044017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf295a07b5e47ee9aee88b6747dad59'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:43.045389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf295a07b5e47ee9aee88b6747dad59'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:43.068411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf295a07b5e47ee9aee88b6747dad59'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:43.069375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e3c6d78b-bc0c-4e67-af47-140be02625b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf295a07b5e47ee9aee88b6747dad59'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:43.093512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 880/1714] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:42 2022] DELETE /identity/v3/users/dbf295a07b5e47ee9aee88b6747dad59 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:43.289512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:43.292983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:43.292983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:43.378875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] MFA Rules not processed for user `b706a6c73a054e6ba4a22d413e1a3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:43.380479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:43.439343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3393b8-4c3d-4bbb-9ad0-b1f6550284f6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:43.442156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3393b8-4c3d-4bbb-9ad0-b1f6550284f6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:43.442156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3393b8-4c3d-4bbb-9ad0-b1f6550284f6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:43.443075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 881/1715] 10.222.0.71 () {54 vars in 912 bytes} [Wed May 18 14:17:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:17:43.451038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:43.451559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:43.451992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:43.501436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:43.529660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:43.575253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 835/1716] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:43.594350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:43.596041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:43.781403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:43.786562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443688b9-1f26-48d1-b115-642b2d9fd1b3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:43.793009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 882/1717] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:43.801375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:43.807086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:43.807086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:43.807086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:43.812749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:43.814738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:43.848403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 836/1718] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:17:43.857752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:43.857752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:43.894969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:43.897888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:43.929126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003533-f403-416d-8b05-396ee61554ad service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:43.945497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:43.951431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:43.951431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:43.951431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:43.965453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:43.967022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:43.971254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:43.990431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 837/1719] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:43.998737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d631b-2c01-41a7-812a-02028df35662 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:44.016095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:44.017862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:44.021537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:44.022013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] PATH_INFO: `/v3/users/a13d0223c50e482da3438ec3892dce4f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:44.025551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a13d0223c50e482da3438ec3892dce4f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:44.036558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:44.222887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:44.224442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:44.283392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1b368-9171-4d6a-a7d3-89a38890d9f8 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:44.301603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:44.302623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:44.303011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:44.303300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] PATH_INFO: `/v3/projects/a177a86465cb44fb8f56e29e4e5e8e95` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:44.341857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a177a86465cb44fb8f56e29e4e5e8e95)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:44.345184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:44.348395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a13d0223c50e482da3438ec3892dce4f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.427544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a13d0223c50e482da3438ec3892dce4f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.428839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a13d0223c50e482da3438ec3892dce4f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.438465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a13d0223c50e482da3438ec3892dce4f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.442438 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3d0d9316-3910-4272-87b8-9d70c9d4002a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a13d0223c50e482da3438ec3892dce4f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.506595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 883/1720] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:43 2022] DELETE /identity/v3/users/a13d0223c50e482da3438ec3892dce4f => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:44.515001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcda0-316b-45ae-b903-dedbc2538510 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:44.515322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcda0-316b-45ae-b903-dedbc2538510 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:44.515576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcda0-316b-45ae-b903-dedbc2538510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:44.579123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c31bcda0-316b-45ae-b903-dedbc2538510 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:44.583891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c31bcda0-316b-45ae-b903-dedbc2538510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:44.585813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a177a86465cb44fb8f56e29e4e5e8e95', 'request_id': 'req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.623967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a177a86465cb44fb8f56e29e4e5e8e95', 'request_id': 'req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.652082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a177a86465cb44fb8f56e29e4e5e8e95', 'request_id': 'req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.786575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 884/1721] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:44.801909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] The token cache is being invalidate because project a177a86465cb44fb8f56e29e4e5e8e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:44.804107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.806240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:44.808689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 838/1722] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:44 2022] DELETE /identity/v3/projects/a177a86465cb44fb8f56e29e4e5e8e95 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:44.813826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296640f-b3af-4ec3-8b0f-12cff5905e73 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:44.816013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296640f-b3af-4ec3-8b0f-12cff5905e73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:44.816013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296640f-b3af-4ec3-8b0f-12cff5905e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:44.852665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:44.858367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:44.884065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c296640f-b3af-4ec3-8b0f-12cff5905e73 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:44.890881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c296640f-b3af-4ec3-8b0f-12cff5905e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:44.914910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 885/1723] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:44.917634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:44.918018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:44.918361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:44.947154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:44.948942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:44.964431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 886/1724] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:44.965798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:44.986346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee306d-5164-4114-9351-b352c21b7b31 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:45.005204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:45.010775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.011179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.011467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.017565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:45.018700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:45.021002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:45.102321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 887/1725] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:45.102667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06a4a9-07f7-4291-acd1-5a21bdcea9a3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:45.106280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:45.121817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:45.122309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.122587 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.122862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.139152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:45.145299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f560eda-14ef-4450-840c-a37e8c96008c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:45.184181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455b28-a30c-4258-9c5a-9825ba3a8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:45.184181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455b28-a30c-4258-9c5a-9825ba3a8876 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.184181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455b28-a30c-4258-9c5a-9825ba3a8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.184181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455b28-a30c-4258-9c5a-9825ba3a8876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.184875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455b28-a30c-4258-9c5a-9825ba3a8876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:45.184875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455b28-a30c-4258-9c5a-9825ba3a8876 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:45.197022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:45.202931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57252055-aefb-463e-a14c-cd544e11e522 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:45.231028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 839/1726] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:45.332091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eadee-dbae-4103-849f-bbd7ddff9e40 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.333508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eadee-dbae-4103-849f-bbd7ddff9e40 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.333956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eadee-dbae-4103-849f-bbd7ddff9e40 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.339520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 840/1727] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:17:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:17:45.378825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 888/1728] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:45.380241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eadee-dbae-4103-849f-bbd7ddff9e40 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:45.427647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.429045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.430045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.539296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:45.550978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:45.621794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:45.773043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eadee-dbae-4103-849f-bbd7ddff9e40 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:45.781317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:45.782096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.782382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.782660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.783636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:45.786219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:45.821585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:45.846710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 889/1729] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:45.848476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:45.852344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:45.880018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb7ac7-95f9-4697-b976-ff5cca23c0c0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:45.895699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:45.897674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:45.898475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:45.899231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] PATH_INFO: `/v3/projects/cc02bed0df4b47c09c6c541313fc4cd2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:45.902259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc02bed0df4b47c09c6c541313fc4cd2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:45.904361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:45.966383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 841/1730] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:45 2022] POST /identity/v3/users => generated 293 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:17:45.976379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:46.018231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ec944-a33d-4ca9-80a2-9722e7400d22 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:46.030878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:46.031894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.032343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.032777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.040070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:46.045301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:46.064419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 842/1731] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:46.090402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:46.097316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:46.147219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfd692-96ea-4046-a8da-325b128e561b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:46.189816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:46.190647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.191109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.191791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.240913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc02bed0df4b47c09c6c541313fc4cd2', 'request_id': 'req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:46.255045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:46.284069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:46.348036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 843/1732] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:46.349880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:46.372104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc02bed0df4b47c09c6c541313fc4cd2', 'request_id': 'req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:46.372104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc02bed0df4b47c09c6c541313fc4cd2', 'request_id': 'req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:46.414073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] The token cache is being invalidate because project cc02bed0df4b47c09c6c541313fc4cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:46.414405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:46.418142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b3b02-712f-401f-87f1-474b4fdd7d3b service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:46.420278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-82f23d37-00ec-4d12-9c29-7d8f9a7dd25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:46.422420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 890/1733] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:45 2022] DELETE /identity/v3/projects/cc02bed0df4b47c09c6c541313fc4cd2 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:46.427878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da04a0-5c53-45c0-8d31-ddc15e6f8cbe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.429334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da04a0-5c53-45c0-8d31-ddc15e6f8cbe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.429334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da04a0-5c53-45c0-8d31-ddc15e6f8cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.454958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d3da04a0-5c53-45c0-8d31-ddc15e6f8cbe None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:46.456518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d3da04a0-5c53-45c0-8d31-ddc15e6f8cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:46.614117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 891/1734] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:46.616930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.616930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.617384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.627354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:46.633425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.633425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.633706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.634488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:46.647700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:46.647902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:46.649632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:46.689351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 844/1735] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:46.697752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 892/1736] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:46.700917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:46.702806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:46.707025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:46.730015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab5fa8-29a4-422f-b820-9d754d33a1c8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:46.731374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f444-d546-4c55-b3e4-070136b8c784 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:46.741666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce68eae-b39d-4e3a-8f10-bc1dae4e8162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:46.742731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce68eae-b39d-4e3a-8f10-bc1dae4e8162 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.743046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce68eae-b39d-4e3a-8f10-bc1dae4e8162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.743332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce68eae-b39d-4e3a-8f10-bc1dae4e8162 admin admin] PATH_INFO: `/v3/projects/07a3a54531bb41d395d96aa3d3e8c175/users/7d39e4f397e247fcb462ed7c4642d631/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.753866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:46.756762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.757323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.757801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.760935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:46.761748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:46.763617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce68eae-b39d-4e3a-8f10-bc1dae4e8162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a3a54531bb41d395d96aa3d3e8c175, user_id=7d39e4f397e247fcb462ed7c4642d631, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:46.764416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:46.766724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce68eae-b39d-4e3a-8f10-bc1dae4e8162 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:46.798707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 893/1737] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:46.803863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:46.819149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98d62b-c135-44e7-b8de-b33be9fb762a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:46.850599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:46.857238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.857755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.858482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:46.860010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:46.867745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:46.933815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 845/1738] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:46 2022] PUT /identity/v3/projects/07a3a54531bb41d395d96aa3d3e8c175/users/7d39e4f397e247fcb462ed7c4642d631/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:46.951874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:46.952729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:46.953698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.016616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 894/1739] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:46 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:47.022041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:47.116041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] MFA Rules not processed for user `7d39e4f397e247fcb462ed7c4642d631`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:47.116041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:47.165657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e9ab4-8299-466d-8af9-fafd307d3de6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:47.172112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:47.173029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:47.173420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:47.173772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.174660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:47.177127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:47.285606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 895/1740] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:47 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:47.286557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:47.292113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:47.323357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 846/1741] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:17:47.323357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:47.341290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b285ae-1bfb-49b0-ac06-677fec2eb574 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:47.356893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:47.365286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:47.366242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:47.366242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] PATH_INFO: `/v3/projects/e85a7a21f93d4b45b4154abcb8b059be` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.375484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85a7a21f93d4b45b4154abcb8b059be)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:47.377652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:47.386259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553089ae-8c07-43a1-aef3-f43e67b036db None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:47.404007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:47.405304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:47.405835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:47.406327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.407737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:47.412378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:47.451495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 847/1742] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:47.458551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:47.491561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd914c-1343-4bda-bcec-2a8811b21fc2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:47.504630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:47.512382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:47.512382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:47.512382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.514058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:47.519963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:47.661755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85a7a21f93d4b45b4154abcb8b059be', 'request_id': 'req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:47.712775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 848/1743] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:47 2022] POST /identity/v3/projects => generated 387 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:47.714960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:47.764851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85a7a21f93d4b45b4154abcb8b059be', 'request_id': 'req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:47.780495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85a7a21f93d4b45b4154abcb8b059be', 'request_id': 'req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:47.884188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5587ff-2a7a-4394-bab1-842083dc1bbf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:47.884347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:47.889297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] The token cache is being invalidate because project e85a7a21f93d4b45b4154abcb8b059be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:47.893738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0455e45-f1aa-482a-98ca-0bffa0b6518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:47.893911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:47.894914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455e45-f1aa-482a-98ca-0bffa0b6518f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:47.895413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455e45-f1aa-482a-98ca-0bffa0b6518f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:47.895887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455e45-f1aa-482a-98ca-0bffa0b6518f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.897031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455e45-f1aa-482a-98ca-0bffa0b6518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:47.901596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:47.901842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0455e45-f1aa-482a-98ca-0bffa0b6518f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:47.918355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:47.923786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 896/1744] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:47 2022] DELETE /identity/v3/projects/e85a7a21f93d4b45b4154abcb8b059be => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:47.924375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 849/1745] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:47.930766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:47.931741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:47.932064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:47.932364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:47.938658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:48.005122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:48.009830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:48.054851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 850/1746] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:48.056435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:48.064907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:48.122063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6bde3-b668-46e9-b837-4a38494d8b8d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.145972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cbcd0-2ec8-47a6-9993-f41e92df3381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.149439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cbcd0-2ec8-47a6-9993-f41e92df3381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.152301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cbcd0-2ec8-47a6-9993-f41e92df3381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.154608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cbcd0-2ec8-47a6-9993-f41e92df3381 admin admin] PATH_INFO: `/v3/projects/4bd74198e5b7405b9271e5e398a589ac/users/534942ebc1314c19877c896fc921b774/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.158939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae17a4a-d6fd-41f8-aae3-60c1a10f7f1d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.188661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1928c7-9135-4263-ad60-203f9a772e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.189437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1928c7-9135-4263-ad60-203f9a772e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.189726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1928c7-9135-4263-ad60-203f9a772e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.190012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1928c7-9135-4263-ad60-203f9a772e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.190730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1928c7-9135-4263-ad60-203f9a772e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.201626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1928c7-9135-4263-ad60-203f9a772e10 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:48.215563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cbcd0-2ec8-47a6-9993-f41e92df3381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd74198e5b7405b9271e5e398a589ac, user_id=534942ebc1314c19877c896fc921b774, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.224179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201cbcd0-2ec8-47a6-9993-f41e92df3381 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:48.363946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 851/1747] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:48 2022] PUT /identity/v3/projects/4bd74198e5b7405b9271e5e398a589ac/users/534942ebc1314c19877c896fc921b774/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:48.365937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.366207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.366552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.407480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 897/1748] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:47 2022] POST /identity/v3/users => generated 294 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:48.412831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.415225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.416765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:48.418202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.422135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:48.577439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] MFA Rules not processed for user `534942ebc1314c19877c896fc921b774`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:48.581939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:48.645573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 852/1749] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:48.646481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:48.677465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd843b-56b9-44d3-bf9a-ce272744878c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.688163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.688916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.689208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.689485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.692383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.698316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:48.722898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 853/1750] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:48.723961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:48.768761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61d6b-8325-47ef-ad7d-74fa04f0fbaf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.787910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 898/1751] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:48.789226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:48.795993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.798108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.798108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.798287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.798952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:17:48.799267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.800946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:48.803852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2addf1f0-273e-4bf0-a7a8-73b5776b3a03 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.813645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.817590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.818286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.818768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.820040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.828511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:48.849345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 854/1752] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:17:48.850367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:48.854692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 899/1753] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:48.855920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:48.872632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831951a7-a69f-40d7-a088-5f04ad965695 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.879011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f818c3-57b7-4ef8-b535-7746577362e4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:48.901715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.902513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.902795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.903073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.904897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.907253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:48.908116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:48.909510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:48.910184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:48.910663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:48.911725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:48.916669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:49.020254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 855/1754] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:48 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:49.021198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.023252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 900/1755] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:48 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:49.030101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.160747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28428c9-cb61-4b8f-aa1e-ca4649e129fc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:49.164202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:49.165766 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bf5e8-2b42-4de1-8ba8-3cdc6e0b1ebd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:49.171111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:49.172827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.173931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.174455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] PATH_INFO: `/v3/projects/e3d4079f10de4566b81a9a9df157af31/users/2b5ea23d53b84f6597904b5bfe0863d8/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.177815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b5528-e7ec-4fe8-9d91-b9200342cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:49.178445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b5528-e7ec-4fe8-9d91-b9200342cc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.178789 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b5528-e7ec-4fe8-9d91-b9200342cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.178990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b5528-e7ec-4fe8-9d91-b9200342cc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.179680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b5528-e7ec-4fe8-9d91-b9200342cc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:49.187854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b5528-e7ec-4fe8-9d91-b9200342cc61 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:49.212829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d4079f10de4566b81a9a9df157af31, user_id=2b5ea23d53b84f6597904b5bfe0863d8, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:49.218123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:49.371123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 856/1756] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:49 2022] PUT /identity/v3/projects/e3d4079f10de4566b81a9a9df157af31/users/2b5ea23d53b84f6597904b5bfe0863d8/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:49.374478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.387178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 901/1757] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:49 2022] POST /identity/v3/users => generated 282 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:49.391744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.392031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.392311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.461193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] MFA Rules not processed for user `2b5ea23d53b84f6597904b5bfe0863d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:49.463858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:49.525559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90e24b-9ef8-47b0-86e4-c8e124178524 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:49.538569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:49.539262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.539542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.539819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.540521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:49.545176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:49.589352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:49.611205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 902/1758] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:49.611205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.621879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1181a5-15c5-4c4f-bbf9-b11e994a19cb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:49.627970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d28ab-14f5-42e5-8621-1de7b3a5e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:49.628661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d28ab-14f5-42e5-8621-1de7b3a5e32e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.628965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d28ab-14f5-42e5-8621-1de7b3a5e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.629241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d28ab-14f5-42e5-8621-1de7b3a5e32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.630030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d28ab-14f5-42e5-8621-1de7b3a5e32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:49.631854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d28ab-14f5-42e5-8621-1de7b3a5e32e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:49.656893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 903/1759] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:49.659299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.660975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.661272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.675393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 857/1760] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:49 2022] POST /identity/v3/users => generated 298 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:49.676739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.696259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165c0c-6d0c-4e4e-8711-c8fb8593e575 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:49.709699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:49.711522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:49.712275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:49.712762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:49.714247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:49.715759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] MFA Rules not processed for user `0b67799c084645a8931ead71981bfbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:49.717051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:49.717364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:49.859988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 858/1761] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:49 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:49.864102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.889957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 904/1762] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:49.891237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:49.923563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b9441-9c61-4353-9bb7-0c5daf058867 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.062285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.063003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.063286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.070589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.079599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.081503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.104486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ccc61-bdd8-4429-9f1d-a28835be4245 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.108253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 905/1763] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:50.109917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.128713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.129909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.130299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.130582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.131341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.134383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.137622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec4e89-ceff-48f7-a01e-40c63218403a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.152128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.152951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.153405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.153686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.154526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.156474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.162592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 859/1764] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:50.163979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.188167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de969fd-17fb-40dd-9e2f-48ee0a7dbb43 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.196161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:50.204884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.208002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.208350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.208685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] PATH_INFO: `/v3/projects/d4a4d6858b0a458ea22dd5d5e6393d1e/users/c264d157b3e044b69b63463a807cc731/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.251383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a4d6858b0a458ea22dd5d5e6393d1e, user_id=c264d157b3e044b69b63463a807cc731, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.254696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.301043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 906/1765] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:50 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:50.301043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.313732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b0324-c51a-4801-9b44-546a243606a5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.319575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.320635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.321594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.321594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] PATH_INFO: `/v3/projects/530c6f76cc2f420d8b22e325dccf3a46/users/241e86b93dfd410681e9f6ad88e45ef2/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.346596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=530c6f76cc2f420d8b22e325dccf3a46, user_id=241e86b93dfd410681e9f6ad88e45ef2, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.347421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 860/1766] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:50 2022] PUT /identity/v3/projects/d4a4d6858b0a458ea22dd5d5e6393d1e/users/c264d157b3e044b69b63463a807cc731/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:50.348381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.352098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.442741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 907/1767] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:50 2022] PUT /identity/v3/projects/530c6f76cc2f420d8b22e325dccf3a46/users/241e86b93dfd410681e9f6ad88e45ef2/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:50.444224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.450535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a262070-1830-48c2-90b0-2b9d96468c0b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.529669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2d128-4753-4c4d-93b8-67fe0c5596a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.530984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2d128-4753-4c4d-93b8-67fe0c5596a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.531269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2d128-4753-4c4d-93b8-67fe0c5596a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.531552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2d128-4753-4c4d-93b8-67fe0c5596a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.532480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2d128-4753-4c4d-93b8-67fe0c5596a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.533582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51452b65-f4a9-4764-8104-152d56e4e5de admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.534431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2d128-4753-4c4d-93b8-67fe0c5596a6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.539509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.540374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.540969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.541906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.542761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.544874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.553857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 861/1768] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:50.555354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.555642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.555918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.559803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 908/1769] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:50.559803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.590751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91b93f-9257-4675-a1e8-a96b6e1cfdb0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.603370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] MFA Rules not processed for user `241e86b93dfd410681e9f6ad88e45ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:50.604968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.605945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.607986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.608096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:50.608188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] PATH_INFO: `/v3/projects/f0bbfb26fd694137882bd04748feebf4/users/a042323e200f426c93be73c695dc929f/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.682811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bbfb26fd694137882bd04748feebf4, user_id=a042323e200f426c93be73c695dc929f, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.702769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.720486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 862/1770] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:50.725219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.753306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd17d-12a4-4e24-86a3-0841692c7373 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.765243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc9514-02e5-4ec1-8cb9-6b63a7a7ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:50.766532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9514-02e5-4ec1-8cb9-6b63a7a7ef8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.767033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9514-02e5-4ec1-8cb9-6b63a7a7ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.767355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9514-02e5-4ec1-8cb9-6b63a7a7ef8c admin admin] PATH_INFO: `/v3/projects/d4a4d6858b0a458ea22dd5d5e6393d1e/users/c264d157b3e044b69b63463a807cc731/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.769710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc9514-02e5-4ec1-8cb9-6b63a7a7ef8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a4d6858b0a458ea22dd5d5e6393d1e, user_id=c264d157b3e044b69b63463a807cc731, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:50.772635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc9514-02e5-4ec1-8cb9-6b63a7a7ef8c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:50.796910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 863/1771] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:50 2022] PUT /identity/v3/projects/d4a4d6858b0a458ea22dd5d5e6393d1e/users/c264d157b3e044b69b63463a807cc731/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:50.799235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255de3-4285-4b7a-9c7a-1e1d50c95bed None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.802601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255de3-4285-4b7a-9c7a-1e1d50c95bed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.802601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad255de3-4285-4b7a-9c7a-1e1d50c95bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.837632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ad255de3-4285-4b7a-9c7a-1e1d50c95bed None None] MFA Rules not processed for user `b706a6c73a054e6ba4a22d413e1a3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:50.837632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad255de3-4285-4b7a-9c7a-1e1d50c95bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:50.844610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 909/1772] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:50 2022] PUT /identity/v3/projects/f0bbfb26fd694137882bd04748feebf4/users/a042323e200f426c93be73c695dc929f/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:50.846819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:50.934280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 864/1773] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:50.935629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:50.935949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:50.936352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:50.991659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab09b6c-6f8a-49f1-b846-690f011c4e21 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:50.999764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.000630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.002163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.002163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.002163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.004694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.029285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] MFA Rules not processed for user `c264d157b3e044b69b63463a807cc731`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:51.033314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:51.121375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 910/1774] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:17:50 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:51.123874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.130333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:51.185151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:51.203562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 865/1775] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:51.218851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.238986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff36f6f-8aca-45f1-bc72-fceb804a5e65 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:51.255558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9341a6-3466-4139-a6a6-21897f7d81d3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:51.260770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.269459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.270078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.271769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.273502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.275950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.305291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 911/1776] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:51.306018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.307898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:51.352980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.354867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.355159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.356292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.357031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.358978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.386734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf321c8-2e07-460f-bcd1-3ebeab0e9497 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:51.392628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.393542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.393662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.393881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.472218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.473920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.474284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 866/1777] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:17:51 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:17:51.481062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.486438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c6919-5c6a-4aa2-b6a9-dd99a62ffb2f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:51.488988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 912/1778] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:51.489837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.492080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7224738-d939-4bad-862d-4beba75c045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.493098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7224738-d939-4bad-862d-4beba75c045c admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.493462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7224738-d939-4bad-862d-4beba75c045c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.493806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7224738-d939-4bad-862d-4beba75c045c admin admin] PATH_INFO: `/v3/projects/f0bbfb26fd694137882bd04748feebf4/users/a042323e200f426c93be73c695dc929f/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.496126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7224738-d939-4bad-862d-4beba75c045c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bbfb26fd694137882bd04748feebf4, user_id=a042323e200f426c93be73c695dc929f, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.499250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7224738-d939-4bad-862d-4beba75c045c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.503415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a8cd3-f9d6-4706-a91f-8c2f5456b4a3 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:51.512173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 867/1779] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:51 2022] PUT /identity/v3/projects/f0bbfb26fd694137882bd04748feebf4/users/a042323e200f426c93be73c695dc929f/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:51.524746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.525092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.525339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.560269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] MFA Rules not processed for user `a042323e200f426c93be73c695dc929f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:51.563385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:51.611305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.612486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.614758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.615040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.623736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.623736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.645360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 913/1780] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:51.646317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.658592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6eb31-e8ba-485d-a575-4991c20321bb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:51.671848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:51.677294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:51.677294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:51.677294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] PATH_INFO: `/v3/projects/2302549e466c4f81b8ad5f0b6b7bb354/users/9c4aadbf97a14c158e079c9a5df48463/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:51.699936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2302549e466c4f81b8ad5f0b6b7bb354, user_id=9c4aadbf97a14c158e079c9a5df48463, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:51.700146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:51.753687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:51.764279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 868/1781] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:51.790694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.829881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 914/1782] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:51 2022] PUT /identity/v3/projects/2302549e466c4f81b8ad5f0b6b7bb354/users/9c4aadbf97a14c158e079c9a5df48463/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:51.831715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:51.844633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:51.948299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca414b2-81f8-40a8-b109-9086d9599d9a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:52.005129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13875c4d-b6dc-4618-9f3f-96dca26725d3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:52.023323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:52.024544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:52.027388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:52.028020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:52.029808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:52.033188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:52.051774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 915/1783] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:17:52.053763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:52.075032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653e78e-7598-40ee-83d2-4a7a8f46acd9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:52.095748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1b83f-6afd-43b2-973e-ed164f48ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:52.097436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1b83f-6afd-43b2-973e-ed164f48ec2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:52.097906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1b83f-6afd-43b2-973e-ed164f48ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:52.098514 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1b83f-6afd-43b2-973e-ed164f48ec2b admin admin] PATH_INFO: `/v3/projects/2302549e466c4f81b8ad5f0b6b7bb354/users/9c4aadbf97a14c158e079c9a5df48463/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:52.101491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1b83f-6afd-43b2-973e-ed164f48ec2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2302549e466c4f81b8ad5f0b6b7bb354, user_id=9c4aadbf97a14c158e079c9a5df48463, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:52.105828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1b83f-6afd-43b2-973e-ed164f48ec2b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:52.124183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:52.126082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:52.126983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:52.128278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:52.139408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 916/1784] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:17:52 2022] PUT /identity/v3/projects/2302549e466c4f81b8ad5f0b6b7bb354/users/9c4aadbf97a14c158e079c9a5df48463/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:52.141684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:52.141983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:52.142368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:52.177954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] MFA Rules not processed for user `9c4aadbf97a14c158e079c9a5df48463`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:52.179469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:52.310257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:52.313283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:52.349079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 869/1785] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:17:52.359495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:52.420749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 917/1786] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:52.454565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:52.467242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688b24d-e8d8-4a14-b5e8-c98854957de6 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:52.583203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:52.632580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc17dc-940e-4d4b-9670-ee717380059d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:52.633614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc17dc-940e-4d4b-9670-ee717380059d service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:52.634020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc17dc-940e-4d4b-9670-ee717380059d service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:52.634305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc17dc-940e-4d4b-9670-ee717380059d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:52.648697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc17dc-940e-4d4b-9670-ee717380059d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:52.651139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc17dc-940e-4d4b-9670-ee717380059d service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:52.691183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 870/1787] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:53.536163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:54.221646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:54.225919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:54.528202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aae50b-3f0d-4abe-81e4-34af980aadea None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:54.538363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:54.542579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:54.543077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:54.543555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] PATH_INFO: `/v3/users/40fef6793ad746778b0627662d5b3025` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:54.546099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fef6793ad746778b0627662d5b3025)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:54.552234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:54.979569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e807e-308a-43af-87d1-587ca2d84ae3 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:54.981040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e807e-308a-43af-87d1-587ca2d84ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:54.982919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e807e-308a-43af-87d1-587ca2d84ae3 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:54.992418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fef6793ad746778b0627662d5b3025'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:55.001411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 871/1788] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:17:54 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:17:55.068311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:55.073965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:55.073965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:55.124130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fef6793ad746778b0627662d5b3025'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:55.125369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fef6793ad746778b0627662d5b3025'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:55.155133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:55.157643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fef6793ad746778b0627662d5b3025'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:55.162575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fef6793ad746778b0627662d5b3025'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:55.171127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:55.241266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:55.304060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 918/1789] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:54 2022] DELETE /identity/v3/users/40fef6793ad746778b0627662d5b3025 => generated 0 bytes in 1078 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:55.658542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 872/1790] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 596 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:17:55.960997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:55.965068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:56.223149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c79a-ebdf-427a-86d5-d364ca404d1d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:56.252669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:56.255169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:56.255886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:56.256466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:56.261353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:56.262997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:56.264261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:56.305877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eb43e-1849-47d5-b646-800b08ae0a21 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:56.528979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:56.528979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:56.529351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:56.529351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:56.529351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:56.529351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:56.555596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:56.558844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 919/1791] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:56.560759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:56.584242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 873/1792] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:57.642503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:57.644932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:57.729969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c3a6-10a7-4577-9e54-ed861f36cf28 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:57.738123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:57.739106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:57.739430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:57.739720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] PATH_INFO: `/v3/users/241e86b93dfd410681e9f6ad88e45ef2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:57.740990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=241e86b93dfd410681e9f6ad88e45ef2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:57.743665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:57.831078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:57.837767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:57.855625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4b99d-851d-4f82-9820-eb820f40d5d0 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:57.862068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:57.862965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:57.863306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:57.863600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] PATH_INFO: `/v3/projects/b097dd9a53ed449ab0dba2d0324e8f94` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:57.865141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b097dd9a53ed449ab0dba2d0324e8f94)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:57.867158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:57.888487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:58.053212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '241e86b93dfd410681e9f6ad88e45ef2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.064532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b097dd9a53ed449ab0dba2d0324e8f94', 'request_id': 'req-1603865e-0df7-4add-ae4c-c2ca405d608e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.098253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b097dd9a53ed449ab0dba2d0324e8f94', 'request_id': 'req-1603865e-0df7-4add-ae4c-c2ca405d608e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.114404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b097dd9a53ed449ab0dba2d0324e8f94', 'request_id': 'req-1603865e-0df7-4add-ae4c-c2ca405d608e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.169984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '241e86b93dfd410681e9f6ad88e45ef2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.170718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '241e86b93dfd410681e9f6ad88e45ef2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.183259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '241e86b93dfd410681e9f6ad88e45ef2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.187610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ab46468-fb45-494f-b7bc-f8e6f2fc8b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '241e86b93dfd410681e9f6ad88e45ef2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.218836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 920/1793] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:57 2022] DELETE /identity/v3/users/241e86b93dfd410681e9f6ad88e45ef2 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:58.225118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:58.227183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:58.227183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:58.258724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:58.260454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:58.361555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] The token cache is being invalidate because project b097dd9a53ed449ab0dba2d0324e8f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:58.362059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.362822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.375962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 874/1794] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:57 2022] DELETE /identity/v3/projects/b097dd9a53ed449ab0dba2d0324e8f94 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:17:58.379502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:58.383568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:58.487507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 921/1795] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:17:58.515120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:58.530451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:58.574459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:58.618222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603865e-0df7-4add-ae4c-c2ca405d608e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:58.633514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:58.635167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:58.635811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:58.636408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] PATH_INFO: `/v3/users/0b67799c084645a8931ead71981bfbbe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:58.641303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b67799c084645a8931ead71981bfbbe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:58.643561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:58.734590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fc722-ba89-4918-971e-8e368b25ecec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:58.734590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:58.734590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:58.734590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:58.735676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:58.735676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:58.737153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:58.751417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 922/1796] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:17:58.943294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b67799c084645a8931ead71981bfbbe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.943958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b67799c084645a8931ead71981bfbbe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:58.944735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b67799c084645a8931ead71981bfbbe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.054033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b67799c084645a8931ead71981bfbbe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.069078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b67799c084645a8931ead71981bfbbe'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.084287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 875/1797] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:58 2022] DELETE /identity/v3/users/0b67799c084645a8931ead71981bfbbe => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:59.300200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:59.301480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:59.316269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577e832-3f83-4566-bb8a-ae475c211a86 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:59.380996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:59.381904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:59.382181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:59.382452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] PATH_INFO: `/v3/projects/530c6f76cc2f420d8b22e325dccf3a46` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:59.383739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530c6f76cc2f420d8b22e325dccf3a46)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:59.385989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:59.432326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:59.434221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:59.448916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92423308-b257-45c7-978e-e70dfc55727b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:59.459280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:59.460226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:59.460509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:59.460915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] PATH_INFO: `/v3/projects/55f6aed2e6c3486f8af4b3a3327c81ec` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:59.464153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f6aed2e6c3486f8af4b3a3327c81ec)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:59.464542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:59.484342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:17:59.511036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530c6f76cc2f420d8b22e325dccf3a46', 'request_id': 'req-71c9353b-a647-4ae5-b11b-7038f0582a08'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.602121 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530c6f76cc2f420d8b22e325dccf3a46', 'request_id': 'req-71c9353b-a647-4ae5-b11b-7038f0582a08'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.611621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530c6f76cc2f420d8b22e325dccf3a46', 'request_id': 'req-71c9353b-a647-4ae5-b11b-7038f0582a08'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.624195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f6aed2e6c3486f8af4b3a3327c81ec', 'request_id': 'req-b6ceb651-3286-42b6-b3df-cc5b230a9a59'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.624762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] The token cache is being invalidate because project 530c6f76cc2f420d8b22e325dccf3a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:59.625215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.625899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.627876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 923/1798] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:59 2022] DELETE /identity/v3/projects/530c6f76cc2f420d8b22e325dccf3a46 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:17:59.631241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f6aed2e6c3486f8af4b3a3327c81ec', 'request_id': 'req-b6ceb651-3286-42b6-b3df-cc5b230a9a59'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.631957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:17:59.633509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:59.639010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f6aed2e6c3486f8af4b3a3327c81ec', 'request_id': 'req-b6ceb651-3286-42b6-b3df-cc5b230a9a59'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.715366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9353b-a647-4ae5-b11b-7038f0582a08 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:17:59.751959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] The token cache is being invalidate because project 55f6aed2e6c3486f8af4b3a3327c81ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:17:59.754840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.754840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b6ceb651-3286-42b6-b3df-cc5b230a9a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:17:59.756888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 876/1799] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:17:59 2022] DELETE /identity/v3/projects/55f6aed2e6c3486f8af4b3a3327c81ec => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:17:59.771123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476a5a-7cae-4c1e-a5a6-58bc137442b7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:59.771547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476a5a-7cae-4c1e-a5a6-58bc137442b7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:59.771846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70476a5a-7cae-4c1e-a5a6-58bc137442b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:59.814703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-70476a5a-7cae-4c1e-a5a6-58bc137442b7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:17:59.817302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-70476a5a-7cae-4c1e-a5a6-58bc137442b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:17:59.860844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:17:59.862839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:59.864861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:59.865328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] PATH_INFO: `/v3/users/9c4aadbf97a14c158e079c9a5df48463` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:17:59.871584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4aadbf97a14c158e079c9a5df48463)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:17:59.875788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:17:59.974620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 877/1800] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:17:59.985692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:17:59.985989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:17:59.986276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.038954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:00.040271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:00.058227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 878/1801] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:00.059589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.080034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213bf4c-2a88-4a55-be94-9f818aff61cc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:00.085493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:00.086449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:00.086740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:00.087012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.088496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:00.089040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:00.090704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:00.108535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 879/1802] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:00.109595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.120501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fabb6d-fe8d-4203-bd01-ef7793b18567 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:00.126084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:00.127145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:00.127643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:00.129200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.130271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:00.132458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:00.153808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4aadbf97a14c158e079c9a5df48463'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:00.245893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4aadbf97a14c158e079c9a5df48463'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:00.247177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4aadbf97a14c158e079c9a5df48463'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:00.269647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4aadbf97a14c158e079c9a5df48463'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:00.271732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 880/1803] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:00 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:00.278357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4aadbf97a14c158e079c9a5df48463'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:00.280510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.284156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:00.320326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 924/1804] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:17:59 2022] DELETE /identity/v3/users/9c4aadbf97a14c158e079c9a5df48463 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:00.398540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d35e5-40a7-4265-889f-a9a2cb8458e4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:00.498017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:00.499389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:00.499974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:00.500568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.501692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:00.509218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:00.577404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.579352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:00.683512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6f594-6712-4001-bdcc-2021e9445e06 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:00.688484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:00.689198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:00.689480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:00.689757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.691714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:00.746570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 881/1805] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:00 2022] POST /identity/v3/users => generated 287 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:00.752019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.814648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:00.816647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:00.823982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab1d03-326b-44d6-9e19-ea6e6a9bb43e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:00.835260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 925/1806] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:00.851005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:00.857832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:00.859841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:00.861355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.864662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:00.868610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:00.896714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 882/1807] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:00.903969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.927266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11aec-c57b-462c-a652-66dc37f5824e service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:00.939809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68496f53-1dad-41fa-b373-d18b37b054d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:00.941460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68496f53-1dad-41fa-b373-d18b37b054d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:00.950202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68496f53-1dad-41fa-b373-d18b37b054d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:00.950202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68496f53-1dad-41fa-b373-d18b37b054d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:00.950202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68496f53-1dad-41fa-b373-d18b37b054d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:00.950202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68496f53-1dad-41fa-b373-d18b37b054d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:00.970821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 926/1808] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:00.976404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:00.989925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b4ccf-fc34-4dcd-9248-331e5882f23f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:01.009470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:01.011795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:01.012204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:01.012758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] PATH_INFO: `/v3/projects/ea86547d81c84851886b16790da3fb96/users/b4ef6c18bad0453aaef3b652748037fc/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:01.037734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea86547d81c84851886b16790da3fb96, user_id=b4ef6c18bad0453aaef3b652748037fc, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:01.043399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:01.247778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 883/1809] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:00 2022] PUT /identity/v3/projects/ea86547d81c84851886b16790da3fb96/users/b4ef6c18bad0453aaef3b652748037fc/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:01.277321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:01.277321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:01.277321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:01.437017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] MFA Rules not processed for user `b4ef6c18bad0453aaef3b652748037fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:01.445905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:01.661945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:01.664050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:01.698486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 927/1810] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:01.699862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:01.792003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934fc0c-2639-46b9-b87b-8e38c2266616 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:01.811209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dedbf0-912c-49d0-be42-21d13c21e192 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:01.814669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:01.815604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:01.815926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:01.816207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:01.816995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:01.819690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:01.824681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:01.825835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:01.826223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:01.826599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] PATH_INFO: `/v3/projects/2302549e466c4f81b8ad5f0b6b7bb354` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:01.833850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2302549e466c4f81b8ad5f0b6b7bb354)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:01.836157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:01.923313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:01.930518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 928/1811] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:01 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:01.937560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:02.031538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2302549e466c4f81b8ad5f0b6b7bb354', 'request_id': 'req-7da6549e-06a5-4757-ac1a-03183d3b4dad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:02.052987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2302549e466c4f81b8ad5f0b6b7bb354', 'request_id': 'req-7da6549e-06a5-4757-ac1a-03183d3b4dad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:02.075262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2302549e466c4f81b8ad5f0b6b7bb354', 'request_id': 'req-7da6549e-06a5-4757-ac1a-03183d3b4dad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:02.138715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b28b0-54ee-4289-b80c-ab8e4801e613 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:02.206282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] The token cache is being invalidate because project 2302549e466c4f81b8ad5f0b6b7bb354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:02.206807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:02.207634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7da6549e-06a5-4757-ac1a-03183d3b4dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:02.212348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 884/1812] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:01 2022] DELETE /identity/v3/projects/2302549e466c4f81b8ad5f0b6b7bb354 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:02.219793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649727-ac3c-4dad-aa58-312c4eceb573 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.220298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649727-ac3c-4dad-aa58-312c4eceb573 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.220760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649727-ac3c-4dad-aa58-312c4eceb573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.248949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:02.250772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.252041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.252538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.258810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:02.267347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:02.308315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8e649727-ac3c-4dad-aa58-312c4eceb573 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:02.310557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8e649727-ac3c-4dad-aa58-312c4eceb573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:02.325860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 885/1813] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:02.346397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.346702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.346948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.417912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 929/1814] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:01 2022] POST /identity/v3/users => generated 293 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:02.420145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:02.423833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:02.427682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:02.433102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:02.458823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0e073-2f85-457e-9e11-6070931b3c84 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:02.470059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 886/1815] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:02.475752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:02.476723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:02.480629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.481389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.483381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.488968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:02.497356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:02.502399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:02.551908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4eb7f-ae47-468a-9bac-76db1b627256 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:02.565602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 930/1816] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:02.573234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:02.581522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:02.583459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.583994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.584438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.585495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:02.585991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:02.590035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:02.642646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191067d-6571-4bcb-9d81-d8ac3ed650a6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:02.657780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:02.661836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.664255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.665191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] PATH_INFO: `/v3/projects/10053ebd82b147e4b68dc7460aca8504/users/4cb14b4dcc694e949393920f1da3eca2/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.667900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 887/1817] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:02.674333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:02.708649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10053ebd82b147e4b68dc7460aca8504, user_id=4cb14b4dcc694e949393920f1da3eca2, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:02.714293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a215-2114-4268-823f-08e09b3c17c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:02.727142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:02.731888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:02.733233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:02.736395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:02.736902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:02.738257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:02.742980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:02.847686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 931/1818] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:02 2022] PUT /identity/v3/projects/10053ebd82b147e4b68dc7460aca8504/users/4cb14b4dcc694e949393920f1da3eca2/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:02.849734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:02.854127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:02.877415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 888/1819] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:02 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:02.879229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:03.050022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa1517-df13-46b6-b13a-f38be019520c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:03.061945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:03.063741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.064579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.065317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.069805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:03.074607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:03.075569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e4786-feaa-4912-bccf-13f71b13aaf7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:03.083288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:03.085917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.088656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.088656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] PATH_INFO: `/v3/users/614732a055b646f1b748928937b5d8a9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.091245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] RBAC: Authorizing `identity:delete_user(user_id=614732a055b646f1b748928937b5d8a9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:03.094179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:03.104971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 889/1820] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:03.106033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:03.118381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910ec2-cd9d-462b-ae96-ea83574776af admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:03.127011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:03.128233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.128536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.129341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.132048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:03.135578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:03.288653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 890/1821] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:03 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:03.289941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:03.314220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5a4df-4d9d-4c1b-a6da-f37c33605d1e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:03.320489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:03.321714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.321864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.322735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] PATH_INFO: `/v3/projects/10053ebd82b147e4b68dc7460aca8504/users/4cb14b4dcc694e949393920f1da3eca2/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.325822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=10053ebd82b147e4b68dc7460aca8504, user_id=4cb14b4dcc694e949393920f1da3eca2, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:03.329090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:03.353060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 891/1822] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:03 2022] PUT /identity/v3/projects/10053ebd82b147e4b68dc7460aca8504/users/4cb14b4dcc694e949393920f1da3eca2/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:03.353060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:03.471343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614732a055b646f1b748928937b5d8a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:03.486426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3a30-5fe5-4258-b5c0-fc70129927ec admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:03.492730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7d734-9ade-47c0-890e-1f27b260b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:03.493665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d734-9ade-47c0-890e-1f27b260b71a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.494493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d734-9ade-47c0-890e-1f27b260b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.495182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7d734-9ade-47c0-890e-1f27b260b71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.496169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d734-9ade-47c0-890e-1f27b260b71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:03.498653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7d734-9ade-47c0-890e-1f27b260b71a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:03.513296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 892/1823] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:03.518144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc210c0-559e-486f-b9e9-af982921a89b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.518445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc210c0-559e-486f-b9e9-af982921a89b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.518736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc210c0-559e-486f-b9e9-af982921a89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.565662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0cc210c0-559e-486f-b9e9-af982921a89b None None] MFA Rules not processed for user `4cb14b4dcc694e949393920f1da3eca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:03.567760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0cc210c0-559e-486f-b9e9-af982921a89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:03.651648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614732a055b646f1b748928937b5d8a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:03.652714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614732a055b646f1b748928937b5d8a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:03.665790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614732a055b646f1b748928937b5d8a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:03.667386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614732a055b646f1b748928937b5d8a9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:03.730137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 932/1824] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:02 2022] DELETE /identity/v3/users/614732a055b646f1b748928937b5d8a9 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:03.732064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:03.734372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:03.741695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 893/1825] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:03.748998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.748998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.748998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.789759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:03.791499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:03.933390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 894/1826] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:03.942040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:03.944037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:03.953196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4aa4e0-3e3e-42d1-a1ef-f912e9c3765e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:03.973131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:03.974746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:03.975882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:03.979819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:03.981443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:03.985301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:04.016388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 933/1827] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:04.018295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:04.023019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:04.066610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47361e6b-aeb7-4413-9510-6ae40788c4a9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:04.106453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:04.106453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:04.106453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:04.106453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:04.253206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8a52b-0b78-4d15-834f-798029c48068 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:04.277319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef29f7-cd41-4541-a4be-3126ea87c88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:04.280341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef29f7-cd41-4541-a4be-3126ea87c88a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:04.283245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef29f7-cd41-4541-a4be-3126ea87c88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:04.284354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef29f7-cd41-4541-a4be-3126ea87c88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:04.309841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:04.317295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:04.328672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef29f7-cd41-4541-a4be-3126ea87c88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:04.331201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef29f7-cd41-4541-a4be-3126ea87c88a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:04.347138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 895/1828] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:04.348009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:04.360557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 934/1829] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:04.366970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cf10b-50ae-409d-9f44-abd7631f56ba service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:04.376158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:04.377154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:04.377485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:04.377801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] PATH_INFO: `/v3/projects/95c63924c42e477e81db95116934b29e/users/d5a6526666e747ab86672b3608104453/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:04.407056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c63924c42e477e81db95116934b29e, user_id=d5a6526666e747ab86672b3608104453, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:04.412216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:04.656740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 896/1830] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:04 2022] PUT /identity/v3/projects/95c63924c42e477e81db95116934b29e/users/d5a6526666e747ab86672b3608104453/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:04.677099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:04.677099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:04.677099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:04.742431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] MFA Rules not processed for user `d5a6526666e747ab86672b3608104453`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:04.746095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:04.828245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:04.831070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:04.921751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 935/1831] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:04.927317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:05.007915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:05.057844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83e9ca-57ad-4ee2-bad4-11cfc26ca85d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.086374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.088590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.088590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.088590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.096946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:05.131708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b670e-5872-423e-99cf-36deedf3f8cc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.141676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.149787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.149787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.149787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.152065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:05.303385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.305172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2df92-3d3d-4bb8-9bcf-1d0f44fa5410 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:05.311109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.313175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38819c3a-2208-4fb4-9842-96f064c0c356 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:05.321623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 897/1832] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:05.325636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93477b-4b53-4830-88e1-bff019466fba None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.325636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93477b-4b53-4830-88e1-bff019466fba None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.325636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93477b-4b53-4830-88e1-bff019466fba None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.327257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 898/1833] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:18:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:18:05.328067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93477b-4b53-4830-88e1-bff019466fba None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:05.328265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 936/1834] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:05.335585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:05.349726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.350013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.350838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.384089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:05.390387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:05.438407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93477b-4b53-4830-88e1-bff019466fba None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.454735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.455423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.455705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.455982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.456692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.460512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:05.557460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 937/1835] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:05.574185 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:05.576437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:05.586706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 899/1836] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:05 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:05.591007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:05.597016 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aec0c-b75a-4813-bb10-5540fea54304 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.749277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5e40-cd82-4296-b08c-699d5db2262d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.765453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.766183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.766456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.766791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.767417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.771253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:05.810594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.812043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.812520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.813079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.833187 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.839441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:05.858670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 938/1837] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:05.860187 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:05.863858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:05.899749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7767f9-9d4c-44c2-98d9-ea4cffc82f67 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.910220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.911143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.911429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.911695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] PATH_INFO: `/v3/projects/97793358b2004a3fa94dec24134b1f1c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.920011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97793358b2004a3fa94dec24134b1f1c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.922032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:05.934903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 900/1838] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:05 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:05.938053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:05.968538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c815e7f-76cc-477b-88f7-a95f00958c4e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:05.976881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:05.978028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:05.979167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:05.979656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:05.981070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:05.984534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:06.009193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 901/1839] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:06.015600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:06.034066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca9a97-bf72-42a1-8252-be5f11fbaabf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:06.042374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:06.043999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:06.044449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:06.044927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] PATH_INFO: `/v3/projects/a1c83fb020fe436b8a7c78b71e3236e0/users/4f75d6e6bc864a95850b15940300bafd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:06.102665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c83fb020fe436b8a7c78b71e3236e0, user_id=4f75d6e6bc864a95850b15940300bafd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:06.112999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:06.118578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97793358b2004a3fa94dec24134b1f1c', 'request_id': 'req-30846ef1-2dc7-4700-ada9-07a527c6acf5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:06.225825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 902/1840] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:06 2022] PUT /identity/v3/projects/a1c83fb020fe436b8a7c78b71e3236e0/users/4f75d6e6bc864a95850b15940300bafd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:06.230750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:06.267330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97793358b2004a3fa94dec24134b1f1c', 'request_id': 'req-30846ef1-2dc7-4700-ada9-07a527c6acf5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:06.283893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97793358b2004a3fa94dec24134b1f1c', 'request_id': 'req-30846ef1-2dc7-4700-ada9-07a527c6acf5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:06.314563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] The token cache is being invalidate because project 97793358b2004a3fa94dec24134b1f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:06.317206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:06.318298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:06.320377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 939/1841] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:05 2022] DELETE /identity/v3/projects/97793358b2004a3fa94dec24134b1f1c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:06.327637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:06.331592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:06.378467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6524b-8169-4daa-80dc-f6dd1b544b35 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:06.390352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:06.392749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:06.393561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:06.394029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:06.395387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:06.398442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:06.434298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 903/1842] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:06.439371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:06.447511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:06.463488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76a8f-1ef6-4f2d-9a91-d67a7de91005 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:06.469721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142682c0-2022-4960-be6a-011df669ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:06.474102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142682c0-2022-4960-be6a-011df669ac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:06.474102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142682c0-2022-4960-be6a-011df669ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:06.474102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142682c0-2022-4960-be6a-011df669ac8f admin admin] PATH_INFO: `/v3/projects/a1c83fb020fe436b8a7c78b71e3236e0/users/4f75d6e6bc864a95850b15940300bafd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:06.474102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142682c0-2022-4960-be6a-011df669ac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c83fb020fe436b8a7c78b71e3236e0, user_id=4f75d6e6bc864a95850b15940300bafd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:06.482170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142682c0-2022-4960-be6a-011df669ac8f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:06.498015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 904/1843] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:06 2022] PUT /identity/v3/projects/a1c83fb020fe436b8a7c78b71e3236e0/users/4f75d6e6bc864a95850b15940300bafd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:06.521989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:06.522539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:06.523496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:06.570331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] MFA Rules not processed for user `4f75d6e6bc864a95850b15940300bafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:06.572067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:06.573914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30846ef1-2dc7-4700-ada9-07a527c6acf5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:06.719653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 905/1844] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:06.737637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:06.742883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:06.754329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:06.760172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:06.760172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:06.760172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] PATH_INFO: `/v3/users/8919a1ceb4f84b7d88cfc6a317cba02b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:06.760172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8919a1ceb4f84b7d88cfc6a317cba02b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:06.763366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:06.892359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8345c1-7984-4941-b879-e0ece7657409 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:06.898889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:06.903788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:06.903788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:06.903788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:06.935844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:06.941241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:06.966199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 906/1845] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:07.149313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8919a1ceb4f84b7d88cfc6a317cba02b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:07.312701 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8919a1ceb4f84b7d88cfc6a317cba02b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:07.313774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8919a1ceb4f84b7d88cfc6a317cba02b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:07.364159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8919a1ceb4f84b7d88cfc6a317cba02b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:07.365397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8919a1ceb4f84b7d88cfc6a317cba02b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:07.430164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 940/1846] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:06 2022] DELETE /identity/v3/users/8919a1ceb4f84b7d88cfc6a317cba02b => generated 0 bytes in 1101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:07.452832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:07.467865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785092-4594-4f82-98a7-2d972576266a service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:07.621371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:07.622737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:07.624182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:07.624844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:07.628770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:07.776440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:07.779003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa3a6b-8d06-492b-b783-0ad808704920 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:07.794492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 907/1847] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:08.251785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:08.255727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:08.473497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710538a0-29b3-4cb9-bafc-524305453382 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:08.495135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:08.505293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:08.505293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:08.505293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] PATH_INFO: `/v3/projects/437731c22c7a48299fd4f11885a9da33` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:08.505293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437731c22c7a48299fd4f11885a9da33)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:08.505293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:08.710656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437731c22c7a48299fd4f11885a9da33', 'request_id': 'req-8954f779-73ac-48d7-8404-c9933577e792'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:08.802096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437731c22c7a48299fd4f11885a9da33', 'request_id': 'req-8954f779-73ac-48d7-8404-c9933577e792'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:08.819803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437731c22c7a48299fd4f11885a9da33', 'request_id': 'req-8954f779-73ac-48d7-8404-c9933577e792'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:08.835989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] The token cache is being invalidate because project 437731c22c7a48299fd4f11885a9da33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:08.836444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:08.837368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8954f779-73ac-48d7-8404-c9933577e792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:08.839950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 941/1848] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:08 2022] DELETE /identity/v3/projects/437731c22c7a48299fd4f11885a9da33 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:08.846858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:08.847712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:08.847712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:08.883156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:08.883156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:09.008078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 908/1849] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:09.023534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.024042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.024834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.063716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:09.065489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:09.081700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 942/1850] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:09.087532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:09.108013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf240f8c-0668-4ca0-a160-023733002649 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:09.117578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:09.125529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.125529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.125529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.125529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:09.125529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:09.126458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:09.143580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 909/1851] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:09.149090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:09.161863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0b5d-636a-4ae9-bdf1-ff0a7e1c01e4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:09.168187 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:09.169096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.169491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.169875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.170765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:09.173176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:09.289992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:09.313378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 943/1852] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:09 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:09.320284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:09.347850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd01f8-9435-437e-8dae-6f28a66dda73 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:09.533370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:09.534852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.535441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.536008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.537738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:09.543778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:09.730738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 910/1853] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:09 2022] POST /identity/v3/users => generated 291 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:09.736280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:09.754588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193e4d4-8ff5-4d42-9641-d783781c3100 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:09.763377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:09.765234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.765981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.766704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.768275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:09.771885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:09.800876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 944/1854] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:09.804824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:09.820251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbdfe4-4792-4772-91ee-c8cd59f6c6c8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:09.830754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:09.832343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.832580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.833301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.834749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:09.839941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:09.861530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 911/1855] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:09.866681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:09.899850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5f67-50e1-4306-abf8-40f7f5236574 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:09.914471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11ac62-8644-42db-b99c-c129101c0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:09.916970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ac62-8644-42db-b99c-c129101c0706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:09.917533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ac62-8644-42db-b99c-c129101c0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:09.918052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ac62-8644-42db-b99c-c129101c0706 admin admin] PATH_INFO: `/v3/projects/26a2eb2c19a04d848c90323b299edcdd/users/ae88c586b1644e6198e1a482b810f95d/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:09.954490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:09.954678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11ac62-8644-42db-b99c-c129101c0706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a2eb2c19a04d848c90323b299edcdd, user_id=ae88c586b1644e6198e1a482b810f95d, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:09.958413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11ac62-8644-42db-b99c-c129101c0706 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:10.061974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:10.064702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:10.088935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b74e-5b39-456d-9531-047cfa2e1fdb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:10.096691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:10.099359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:10.099901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:10.100382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] PATH_INFO: `/v3/users/534942ebc1314c19877c896fc921b774` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:10.102596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534942ebc1314c19877c896fc921b774)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:10.108058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:10.110911 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 945/1856] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:09 2022] PUT /identity/v3/projects/26a2eb2c19a04d848c90323b299edcdd/users/ae88c586b1644e6198e1a482b810f95d/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:10.122861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:10.123151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:10.123433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:10.157334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] MFA Rules not processed for user `ae88c586b1644e6198e1a482b810f95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:10.158591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:10.267451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 946/1857] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:10.272520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:10.373060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c418ad-0e3a-4143-bb5f-696ac156db65 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:10.382415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:10.384045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:10.386611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:10.387108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:10.388372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:10.392146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:10.466891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534942ebc1314c19877c896fc921b774'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:10.468373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534942ebc1314c19877c896fc921b774'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:10.471105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534942ebc1314c19877c896fc921b774'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:10.555521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534942ebc1314c19877c896fc921b774'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:10.620679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 947/1858] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:10 2022] POST /identity/v3/projects => generated 381 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:10.624034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:10.639087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:10.672701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2b25637-33de-4923-9404-e3236d8d59f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534942ebc1314c19877c896fc921b774'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:10.712312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 912/1859] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:10 2022] DELETE /identity/v3/users/534942ebc1314c19877c896fc921b774 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:10.719357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:10.725086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:10.725086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:10.785755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:10.791782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:10.853897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff88a74-05a6-4ea4-b8dd-8ebce39571c9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:11.098023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 913/1860] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:11.103983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:11.105488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.105950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.106401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.110860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:11.111001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:11.115201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:11.130359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:11.243059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710992b7-8362-44be-b3e4-e5c67c3f0998 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:11.249964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:11.250240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.250667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.251133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.268372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:11.270971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:11.294284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 914/1861] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:11.332355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 948/1862] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:10 2022] POST /identity/v3/users => generated 297 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:11.336659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:11.354858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16295-cacb-4e8a-a3e5-f11fa47bd5bc service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:11.363727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:11.365945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.366599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.373088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.373088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:11.373088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:11.390153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 915/1863] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:18:11.395635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:11.411748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b5807-5c3e-419e-9a82-e4f0efb08b77 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:11.419387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:11.420826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.421614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.421965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] PATH_INFO: `/v3/projects/269e006e157546fa9b511e99c5ccdbec/users/95c6d8cfad52459db4cbd157de1d7acd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.445377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e006e157546fa9b511e99c5ccdbec, user_id=95c6d8cfad52459db4cbd157de1d7acd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:11.450178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:11.574952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 949/1864] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:11 2022] PUT /identity/v3/projects/269e006e157546fa9b511e99c5ccdbec/users/95c6d8cfad52459db4cbd157de1d7acd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:11.577024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:11.592925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24857537-8397-45ce-abe5-b7a79a64def1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:11.724734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac12cd-c1eb-45dd-868b-05510f5be0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:11.725811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac12cd-c1eb-45dd-868b-05510f5be0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.726184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac12cd-c1eb-45dd-868b-05510f5be0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.726545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac12cd-c1eb-45dd-868b-05510f5be0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.727474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac12cd-c1eb-45dd-868b-05510f5be0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:11.730090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac12cd-c1eb-45dd-868b-05510f5be0ec admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:11.748195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 916/1865] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:11.748819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:11.770250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a7c6-8d9f-415d-be8f-5332f6259d2f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:11.779084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:11.780656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.781178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.781649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] PATH_INFO: `/v3/projects/269e006e157546fa9b511e99c5ccdbec/users/95c6d8cfad52459db4cbd157de1d7acd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.785343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269e006e157546fa9b511e99c5ccdbec, user_id=95c6d8cfad52459db4cbd157de1d7acd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:11.791209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:11.814983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 950/1866] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:11 2022] PUT /identity/v3/projects/269e006e157546fa9b511e99c5ccdbec/users/95c6d8cfad52459db4cbd157de1d7acd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:11.829617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:11.830080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:11.830514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:11.873692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] MFA Rules not processed for user `95c6d8cfad52459db4cbd157de1d7acd`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:11.874959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:11.968815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:11.972251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:12.001097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 917/1867] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:12.151593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc84c5-e3ec-41a3-853e-2be079be1fa2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:12.160894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:12.162415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:12.163134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:12.163628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] PATH_INFO: `/v3/projects/4bd74198e5b7405b9271e5e398a589ac` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:12.167047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd74198e5b7405b9271e5e398a589ac)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:12.170416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:12.404436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd74198e5b7405b9271e5e398a589ac', 'request_id': 'req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.527889 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd74198e5b7405b9271e5e398a589ac', 'request_id': 'req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.543096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd74198e5b7405b9271e5e398a589ac', 'request_id': 'req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.557661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] The token cache is being invalidate because project 4bd74198e5b7405b9271e5e398a589ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:12.558119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.558887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.560677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 951/1868] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:11 2022] DELETE /identity/v3/projects/4bd74198e5b7405b9271e5e398a589ac => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:12.566393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:12.579027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a4290-384c-4f0d-9856-99a2dec9e126 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:12.656727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:12.657673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:12.657960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:12.658237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] PATH_INFO: `/v3/users/c264d157b3e044b69b63463a807cc731` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:12.659563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c264d157b3e044b69b63463a807cc731)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:12.661590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:12.927979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c264d157b3e044b69b63463a807cc731'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.928901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c264d157b3e044b69b63463a807cc731'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:12.929678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c264d157b3e044b69b63463a807cc731'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:13.010264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c264d157b3e044b69b63463a807cc731'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:13.033477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c264d157b3e044b69b63463a807cc731'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:13.060746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 918/1869] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:12 2022] DELETE /identity/v3/users/c264d157b3e044b69b63463a807cc731 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:13.174630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:13.176945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:13.292752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c575c5-b47f-4752-a5c5-b0e3bcafa94f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:13.354076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:13.357151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:13.357607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:13.357951 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:13.360603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:13.470472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:13.473436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:13.491564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 952/1870] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:13.621636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:13.623901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:13.634706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:13.737123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:13.741263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:13.773791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435808-a7bb-472a-8b27-165f5e0c056a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:13.781684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:13.782975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:13.783314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:13.783747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] PATH_INFO: `/v3/users/7d39e4f397e247fcb462ed7c4642d631` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:13.785460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d39e4f397e247fcb462ed7c4642d631)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:13.787937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:13.930728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecd23e-2dcf-4b5d-85ba-5acd05ed16ac service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:13.944490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:13.952287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:13.952287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:13.952287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] PATH_INFO: `/v3/projects/d4a4d6858b0a458ea22dd5d5e6393d1e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:13.952287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a4d6858b0a458ea22dd5d5e6393d1e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:13.952287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:14.127241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:14.134237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d39e4f397e247fcb462ed7c4642d631'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.135869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d39e4f397e247fcb462ed7c4642d631'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.136708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d39e4f397e247fcb462ed7c4642d631'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.138739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a4d6858b0a458ea22dd5d5e6393d1e', 'request_id': 'req-49980b97-9c80-4b82-b370-f3e2bcf38c16'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.341845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d39e4f397e247fcb462ed7c4642d631'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.365331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67dcefee-2df0-43b3-8b8f-f32dc5e980a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d39e4f397e247fcb462ed7c4642d631'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.391685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 919/1871] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:13 2022] DELETE /identity/v3/users/7d39e4f397e247fcb462ed7c4642d631 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:14.396836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc287e1f-dc20-4ffa-bf79-cd23c88c4d12 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.397122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc287e1f-dc20-4ffa-bf79-cd23c88c4d12 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.397400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc287e1f-dc20-4ffa-bf79-cd23c88c4d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.418215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fc287e1f-dc20-4ffa-bf79-cd23c88c4d12 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:14.419450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fc287e1f-dc20-4ffa-bf79-cd23c88c4d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:14.472985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a4d6858b0a458ea22dd5d5e6393d1e', 'request_id': 'req-49980b97-9c80-4b82-b370-f3e2bcf38c16'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.498084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a4d6858b0a458ea22dd5d5e6393d1e', 'request_id': 'req-49980b97-9c80-4b82-b370-f3e2bcf38c16'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.528872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 920/1872] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:14.529062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] The token cache is being invalidate because project d4a4d6858b0a458ea22dd5d5e6393d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:14.529062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.529448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:14.536308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 953/1873] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:13 2022] DELETE /identity/v3/projects/d4a4d6858b0a458ea22dd5d5e6393d1e => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:14.538453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86c6a1-fd30-4784-9238-3e45ffad523e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.538833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86c6a1-fd30-4784-9238-3e45ffad523e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.539245 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86c6a1-fd30-4784-9238-3e45ffad523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.544076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:14.546537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:14.576192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8e86c6a1-fd30-4784-9238-3e45ffad523e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:14.578517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8e86c6a1-fd30-4784-9238-3e45ffad523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:14.595328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 921/1874] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:14.610438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.610926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.611409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.645912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:14.648213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:14.666051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 922/1875] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:14.669885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49980b97-9c80-4b82-b370-f3e2bcf38c16 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:14.672632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:14.690636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1592d-9353-4b89-82fe-f34693231b97 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:14.699616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:14.700918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.701372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.701870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.703327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:14.706077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:14.706777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:14.729333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 923/1876] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:14.733791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:14.739275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:14.740603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.740603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.741042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.743048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:14.746192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c33b7-a420-4a9b-aabd-dec9a887e2bb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:14.751044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:14.752007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.752388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.752756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.759244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:14.759244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:14.760040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:14.760040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:14.781468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 954/1877] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:14.860006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 924/1878] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:14 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:14.865072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:14.879985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5eab-41eb-493d-8018-6d8811563720 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:14.957255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:14.958529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:14.958918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:14.959203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:14.959909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:14.961974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.130364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 955/1879] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:14 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:15.137845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.151525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.157318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:15.157863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b833-55df-461f-a53d-26b6dbdd4544 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.165233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.167274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.167816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.168292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.169769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.172017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.188004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 925/1880] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:15.193607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.208497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbde43-6c45-44f2-9d09-8a98b03308fa admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.218243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.219491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.220175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.220831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.222123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.224670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.249532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 926/1881] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:15.257653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.277515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45efa5-efea-4f91-a6f1-4ef39ea537b7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.285715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b935a-48d5-4a40-ad48-d4ab72885449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.287437 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b935a-48d5-4a40-ad48-d4ab72885449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.287710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b935a-48d5-4a40-ad48-d4ab72885449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.288181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b935a-48d5-4a40-ad48-d4ab72885449 admin admin] PATH_INFO: `/v3/projects/c382424235bd4a8d8e2ddd15995b1bd6/users/d0a97c45b5804f21ae9f487e00b6bbe5/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.301396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2c114-d088-4d97-8ea2-aa80cb271643 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.310284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95c6d8cfad52459db4cbd157de1d7acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269e006e157546fa9b511e99c5ccdbec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.310985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.311323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.312002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.313550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:15.314077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.316373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.317380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b935a-48d5-4a40-ad48-d4ab72885449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c382424235bd4a8d8e2ddd15995b1bd6, user_id=d0a97c45b5804f21ae9f487e00b6bbe5, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.323736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b935a-48d5-4a40-ad48-d4ab72885449 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.339514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:15.342638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 956/1882] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:15.348133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.362966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673c194-e4f9-4a2e-9909-3da5d5c95ffa tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.374708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95c6d8cfad52459db4cbd157de1d7acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269e006e157546fa9b511e99c5ccdbec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.375887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.376416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.377133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.378445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.382324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.495890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 927/1883] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:15 2022] PUT /identity/v3/projects/c382424235bd4a8d8e2ddd15995b1bd6/users/d0a97c45b5804f21ae9f487e00b6bbe5/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:15.516819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.517152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.517519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.571496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] MFA Rules not processed for user `d0a97c45b5804f21ae9f487e00b6bbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:15.577887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 957/1884] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:15 2022] POST /identity/v3/projects => generated 354 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:15.578836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:15.582483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.714229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 928/1885] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:15.733214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55385d27-3910-43e4-8cd8-c014e005cf4f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.741024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95c6d8cfad52459db4cbd157de1d7acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269e006e157546fa9b511e99c5ccdbec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.742309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.742934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.744133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.745313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.748706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:15.748706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.748938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:15.750646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.783569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 958/1886] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:15.839033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:15.844622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:15.893969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c7dc2-f2ae-41d8-a8fe-ce48d72af150 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:15.898288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:15.899456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:15.901549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:15.901915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:15.918541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:15.921555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:15.943768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 929/1887] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:15.995074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53536738-d9e4-47f1-98b8-71b0a87076ec tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:16.001785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:16.002415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:16.002761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:16.003172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] PATH_INFO: `/v3/projects/07a3a54531bb41d395d96aa3d3e8c175` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:16.005475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a3a54531bb41d395d96aa3d3e8c175)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:16.007800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:16.057092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:16.169659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a3a54531bb41d395d96aa3d3e8c175', 'request_id': 'req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.310450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a3a54531bb41d395d96aa3d3e8c175', 'request_id': 'req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.318867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a3a54531bb41d395d96aa3d3e8c175', 'request_id': 'req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.338730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] The token cache is being invalidate because project 07a3a54531bb41d395d96aa3d3e8c175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:16.339226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.340460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.347113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 959/1888] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:15 2022] DELETE /identity/v3/projects/07a3a54531bb41d395d96aa3d3e8c175 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:16.348844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:16.372678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855389c-1d2c-4402-9263-8097c18dec9e service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:16.473831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:16.475492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:16.476088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:16.476593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] PATH_INFO: `/v3/users/2b5ea23d53b84f6597904b5bfe0863d8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:16.478804 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5ea23d53b84f6597904b5bfe0863d8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:16.481803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:16.740141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5ea23d53b84f6597904b5bfe0863d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.740865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5ea23d53b84f6597904b5bfe0863d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.741410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5ea23d53b84f6597904b5bfe0863d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.864828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5ea23d53b84f6597904b5bfe0863d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.898397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5ea23d53b84f6597904b5bfe0863d8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:16.919788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 930/1889] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:16 2022] DELETE /identity/v3/users/2b5ea23d53b84f6597904b5bfe0863d8 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:16.949715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:16.952242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:17.090322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db024d9e-dc51-44bf-aa61-3f7f95ab0ed0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:17.257319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95c6d8cfad52459db4cbd157de1d7acd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '269e006e157546fa9b511e99c5ccdbec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:17.258610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:17.258894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:17.259447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] PATH_INFO: `/v3/projects/279c620d38e04d7291c3922d31b2305a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:17.262058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorizing `identity:delete_project(project_id=279c620d38e04d7291c3922d31b2305a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:17.264225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:17.446423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:17.460880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279c620d38e04d7291c3922d31b2305a', 'request_id': 'req-4c368798-d57b-45d9-8a1c-031862e1528f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:17.608771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279c620d38e04d7291c3922d31b2305a', 'request_id': 'req-4c368798-d57b-45d9-8a1c-031862e1528f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:17.623823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279c620d38e04d7291c3922d31b2305a', 'request_id': 'req-4c368798-d57b-45d9-8a1c-031862e1528f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:17.646184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] The token cache is being invalidate because project 279c620d38e04d7291c3922d31b2305a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:17.646660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:17.647733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:17.650849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 960/1890] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:16 2022] DELETE /identity/v3/projects/279c620d38e04d7291c3922d31b2305a => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:17.672948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:17.675072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:17.777287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26324326-4fcb-4a67-95e3-34835e923a36 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:17.851437 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:17.852323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:17.852608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:17.853514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] PATH_INFO: `/v3/projects/e3d4079f10de4566b81a9a9df157af31` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:17.854926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d4079f10de4566b81a9a9df157af31)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:17.856921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:18.015661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d4079f10de4566b81a9a9df157af31', 'request_id': 'req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.023897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d4079f10de4566b81a9a9df157af31', 'request_id': 'req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.032499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d4079f10de4566b81a9a9df157af31', 'request_id': 'req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.139150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] The token cache is being invalidate because project e3d4079f10de4566b81a9a9df157af31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:18.139452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.140221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.143011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 931/1891] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:17 2022] DELETE /identity/v3/projects/e3d4079f10de4566b81a9a9df157af31 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:18.147799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:18.150866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:18.172623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c368798-d57b-45d9-8a1c-031862e1528f tempest-VolumeQuotaClassesTest-1670382054 tempest-VolumeQuotaClassesTest-1670382054-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:18.259702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:18.261258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:18.261768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:18.262592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] PATH_INFO: `/v3/users/a042323e200f426c93be73c695dc929f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:18.266629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a042323e200f426c93be73c695dc929f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:18.270996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:18.546650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a042323e200f426c93be73c695dc929f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.554021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:18.557248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:18.582985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d8b11-dfd9-4aac-b236-5d2d029d0bee admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:18.592023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:18.593872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:18.594467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:18.595132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] PATH_INFO: `/v3/users/ae88c586b1644e6198e1a482b810f95d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:18.597877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae88c586b1644e6198e1a482b810f95d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:18.601349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:18.679632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:18.682059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a042323e200f426c93be73c695dc929f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.684024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a042323e200f426c93be73c695dc929f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.697172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a042323e200f426c93be73c695dc929f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.698535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-37462450-b3b0-4dcb-9f60-b25095ce10c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a042323e200f426c93be73c695dc929f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.734340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 961/1892] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:18 2022] DELETE /identity/v3/users/a042323e200f426c93be73c695dc929f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:18.903613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae88c586b1644e6198e1a482b810f95d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.905064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae88c586b1644e6198e1a482b810f95d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:18.906246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae88c586b1644e6198e1a482b810f95d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:19.035813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae88c586b1644e6198e1a482b810f95d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:19.054670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae88c586b1644e6198e1a482b810f95d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:19.073609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 932/1893] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:18 2022] DELETE /identity/v3/users/ae88c586b1644e6198e1a482b810f95d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:19.078905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:19.079276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:19.079692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:19.104629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:19.105945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:19.250690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 962/1894] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:19.263306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:19.269127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:19.270800 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:19.389481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d37dc-0c9c-412f-80e6-d74aaa3afb7d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:19.400850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab8d89-d903-4b76-981d-761934b32a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:19.407504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8d89-d903-4b76-981d-761934b32a4e service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:19.411061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8d89-d903-4b76-981d-761934b32a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:19.411061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab8d89-d903-4b76-981d-761934b32a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:19.443819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab8d89-d903-4b76-981d-761934b32a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:19.446539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab8d89-d903-4b76-981d-761934b32a4e service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:19.477097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 933/1895] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:19.546106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:19.548546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:19.583962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155cc1b-a7ca-44f3-8e33-ca57a907fefa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:19.601287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:19.607747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:19.607747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:19.609809 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] PATH_INFO: `/v3/projects/f0bbfb26fd694137882bd04748feebf4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:19.612742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bbfb26fd694137882bd04748feebf4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:19.616886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:19.845001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:19.941732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bbfb26fd694137882bd04748feebf4', 'request_id': 'req-65fbc436-ee0f-4329-bd01-b24acebe825f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.051449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bbfb26fd694137882bd04748feebf4', 'request_id': 'req-65fbc436-ee0f-4329-bd01-b24acebe825f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.064752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bbfb26fd694137882bd04748feebf4', 'request_id': 'req-65fbc436-ee0f-4329-bd01-b24acebe825f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.115817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] The token cache is being invalidate because project f0bbfb26fd694137882bd04748feebf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:20.115817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.115817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65fbc436-ee0f-4329-bd01-b24acebe825f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.115817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 963/1896] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:19 2022] DELETE /identity/v3/projects/f0bbfb26fd694137882bd04748feebf4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:20.121482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:20.122314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:20.122774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:20.190464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:20.195001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:20.285283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:20.358278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 934/1897] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:20.367461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:20.368888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:20.369105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:20.396227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:20.398163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:20.411313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 964/1898] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:20.418129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:20.431550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8f8df-a8f3-4c32-a803-6bdf854d9713 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:20.437750 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:20.438792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:20.439308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:20.439786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:20.440767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:20.447679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:20.447679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:20.460065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 935/1899] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:20.467863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:20.482889 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196c9c-ca5e-4b4c-a588-cffd27b559bc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:20.483174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:20.485469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:20.502322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6ff5e-be2a-4a13-a8e9-5afaa6e5b610 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:20.503548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:20.507339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:20.507988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:20.508465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:20.512316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:20.513840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:20.516255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:20.516968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:20.517450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] PATH_INFO: `/v3/projects/26a2eb2c19a04d848c90323b299edcdd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:20.519755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a2eb2c19a04d848c90323b299edcdd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:20.524362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:20.534124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:20.649488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:20.690654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 965/1900] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:20 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:20.698098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:20.711409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a2eb2c19a04d848c90323b299edcdd', 'request_id': 'req-b4cad7a8-2008-4bb2-9fdb-78509653ab24'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.720541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a2eb2c19a04d848c90323b299edcdd', 'request_id': 'req-b4cad7a8-2008-4bb2-9fdb-78509653ab24'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.736896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a2eb2c19a04d848c90323b299edcdd', 'request_id': 'req-b4cad7a8-2008-4bb2-9fdb-78509653ab24'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.825610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24349e-5ea6-4acb-a0ed-cef91bba14e4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:20.834279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:20.835469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:20.836234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:20.836696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:20.839577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:20.843310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:20.865595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] The token cache is being invalidate because project 26a2eb2c19a04d848c90323b299edcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:20.866379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.868201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:20.871424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 936/1901] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:20 2022] DELETE /identity/v3/projects/26a2eb2c19a04d848c90323b299edcdd => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:20.882920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:20.889458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:21.036986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cad7a8-2008-4bb2-9fdb-78509653ab24 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:21.047680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:21.051364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:21.052151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:21.052902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] PATH_INFO: `/v3/users/95c6d8cfad52459db4cbd157de1d7acd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:21.054042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 966/1902] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:20 2022] POST /identity/v3/users => generated 292 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:21.056980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c6d8cfad52459db4cbd157de1d7acd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:21.059325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:21.062413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:21.065942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:21.101205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad28b81-986d-4ec1-b988-701c71dda12c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:21.109576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:21.110664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:21.111303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:21.111780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:21.113125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:21.116246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:21.138799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 967/1903] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:21.142643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:21.155556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede1a6-6d5f-4b4f-9abd-5550a87d945a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:21.163070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:21.164511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:21.165008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:21.165633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:21.167447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:21.169887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:21.185501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 968/1904] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:21.191212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:21.205397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a371e6-e3e5-4a0e-8f9e-e39f221ebfcc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:21.212615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc21895-2560-40e8-8728-9dfd62e1139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:21.215196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21895-2560-40e8-8728-9dfd62e1139d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:21.215196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21895-2560-40e8-8728-9dfd62e1139d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:21.215196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21895-2560-40e8-8728-9dfd62e1139d admin admin] PATH_INFO: `/v3/projects/d2248a64e1f44ec48f83745a11e639d0/users/762912d8515f45c79faaa3f8094597b3/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:21.276947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc21895-2560-40e8-8728-9dfd62e1139d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2248a64e1f44ec48f83745a11e639d0, user_id=762912d8515f45c79faaa3f8094597b3, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:21.288410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc21895-2560-40e8-8728-9dfd62e1139d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:21.419256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c6d8cfad52459db4cbd157de1d7acd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:21.423433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c6d8cfad52459db4cbd157de1d7acd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:21.424453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c6d8cfad52459db4cbd157de1d7acd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:21.440532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 969/1905] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:21 2022] PUT /identity/v3/projects/d2248a64e1f44ec48f83745a11e639d0/users/762912d8515f45c79faaa3f8094597b3/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:21.453621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:21.454281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:21.454772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:21.488754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] MFA Rules not processed for user `762912d8515f45c79faaa3f8094597b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:21.490420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:21.553085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c6d8cfad52459db4cbd157de1d7acd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:21.583031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c6d8cfad52459db4cbd157de1d7acd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:21.617780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 937/1906] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:20 2022] DELETE /identity/v3/users/95c6d8cfad52459db4cbd157de1d7acd => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:21.733890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 970/1907] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:21.735198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:21.738621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:21.894893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3964a-2db5-4a39-bfbb-2e8a902679b9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:21.901719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:21.902278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:21.902643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:21.902980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:21.903909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:21.906112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:22.025018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 938/1908] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:21 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:22.028191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:22.145885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a2119-5889-4414-89f4-679a45d5ddac None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:22.299251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:22.329166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:22.330815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:22.331065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:22.331343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:22.332150 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:22.342858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:22.471622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:22.474700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:22.523318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08466e3a-c87f-4c37-aa76-ca0817c3ea1e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:22.546281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 971/1909] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:22 2022] POST /identity/v3/users => generated 297 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:22.548182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:22.550052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:22.550549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:22.551038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] PATH_INFO: `/v3/projects/269e006e157546fa9b511e99c5ccdbec` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:22.552067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:22.554075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=269e006e157546fa9b511e99c5ccdbec)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:22.562161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:22.585759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e4ed2-5fc0-4405-b7df-45982ba5d539 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:22.597298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:22.598632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:22.599248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:22.600588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:22.601678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:22.605209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:22.611483 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:22.629129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 972/1910] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:22.639711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:22.666325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d480ce-479d-4bcb-8579-d815baa63441 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:22.677765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:22.684155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:22.685034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:22.685666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] PATH_INFO: `/v3/projects/6568213c61ed45d088585d8adef034fe/users/4ffe4f56fd184fec94cf06b83ebb4305/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:22.722878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6568213c61ed45d088585d8adef034fe, user_id=4ffe4f56fd184fec94cf06b83ebb4305, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:22.730604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:22.886107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 973/1911] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:22 2022] PUT /identity/v3/projects/6568213c61ed45d088585d8adef034fe/users/4ffe4f56fd184fec94cf06b83ebb4305/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:22.892874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:22.910118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269e006e157546fa9b511e99c5ccdbec', 'request_id': 'req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:22.935748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269e006e157546fa9b511e99c5ccdbec', 'request_id': 'req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:22.958068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269e006e157546fa9b511e99c5ccdbec', 'request_id': 'req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:23.069849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d956-49bd-43db-9a28-ebb7b26bc13c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:23.073027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:23.086950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:23.088336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.088833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.089305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.090906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:23.095069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:23.096906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] The token cache is being invalidate because project 269e006e157546fa9b511e99c5ccdbec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:23.099864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:23.102571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fe4ac174-8228-49c3-9dd4-02cbbc4dce6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:23.114490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 939/1912] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:22 2022] DELETE /identity/v3/projects/269e006e157546fa9b511e99c5ccdbec => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:23.117503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f899a-5834-482a-b158-f475ac3fac06 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.117989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f899a-5834-482a-b158-f475ac3fac06 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.121105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f899a-5834-482a-b158-f475ac3fac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.129950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 974/1913] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:23.131962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:23.137688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:23.158619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39214b-362a-448b-b13d-9b6b04c3584a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:23.170160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c56b41-1f32-4926-9a0a-154d7bf1f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:23.171509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c56b41-1f32-4926-9a0a-154d7bf1f17f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.171960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c56b41-1f32-4926-9a0a-154d7bf1f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.172394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c56b41-1f32-4926-9a0a-154d7bf1f17f admin admin] PATH_INFO: `/v3/projects/6568213c61ed45d088585d8adef034fe/users/4ffe4f56fd184fec94cf06b83ebb4305/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.177973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c56b41-1f32-4926-9a0a-154d7bf1f17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6568213c61ed45d088585d8adef034fe, user_id=4ffe4f56fd184fec94cf06b83ebb4305, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:23.186188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c56b41-1f32-4926-9a0a-154d7bf1f17f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:23.213671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 975/1914] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:23 2022] PUT /identity/v3/projects/6568213c61ed45d088585d8adef034fe/users/4ffe4f56fd184fec94cf06b83ebb4305/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:23.226591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.227506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.230293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.235422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e21f899a-5834-482a-b158-f475ac3fac06 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:23.241039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e21f899a-5834-482a-b158-f475ac3fac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:23.304101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] MFA Rules not processed for user `4ffe4f56fd184fec94cf06b83ebb4305`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:23.307663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:23.435685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 940/1915] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:23.452288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.453331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.453686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.477008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 976/1916] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:23.498631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:23.501626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:23.513386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:23.516731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:23.532517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 941/1917] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:23.538802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:23.556944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7deba-7909-4a01-a330-ebb2dd5444c1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:23.577239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:23.580830 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.581415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.581977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.583340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:23.583946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:23.589790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:23.620571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0a5b0-76e7-4d23-b31f-cf24d69b8c89 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:23.625150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 942/1918] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:23.629141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:23.631662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:23.632608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.633676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.640875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.653866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafac25-d8e2-4bf2-b446-add7d15b05ee admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:23.661327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:23.662057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:23.663650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.664141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.664641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:23.664901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.667540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:23.672580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:23.689107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 977/1919] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:23.774152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:23.778047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:23.803433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77627e-a1a3-4f87-9bbd-037af6b71107 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:23.820223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:23.823891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:23.824566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:23.825092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] PATH_INFO: `/v3/users/d0a97c45b5804f21ae9f487e00b6bbe5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:23.827491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a97c45b5804f21ae9f487e00b6bbe5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:23.833265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:23.897332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 943/1920] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:23 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:23.897332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:23.899036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:24.018781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfb376-ef77-427b-8ebf-36351988b71e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:24.026498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:24.027632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.028086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.028525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.031453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:24.124943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:24.126929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:24.139363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 944/1921] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:24.140741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:24.198251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a97c45b5804f21ae9f487e00b6bbe5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:24.310066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04642-7959-4860-8080-66c5e3aa6be4 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:24.323485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:24.326133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.328636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.332409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.339144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:24.345785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:24.351066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a97c45b5804f21ae9f487e00b6bbe5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:24.352450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a97c45b5804f21ae9f487e00b6bbe5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:24.388865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a97c45b5804f21ae9f487e00b6bbe5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:24.393888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25abe33d-13b2-465c-801e-e3308be8bf88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a97c45b5804f21ae9f487e00b6bbe5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:24.475636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 978/1922] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:23 2022] DELETE /identity/v3/users/d0a97c45b5804f21ae9f487e00b6bbe5 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:24.480734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.482567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.483030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.520196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:24.522321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:24.553641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 945/1923] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:24 2022] POST /identity/v3/users => generated 292 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:24.560027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:24.562738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:24.584748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c92666-e83b-4fb9-ad6b-ef6d256911ca admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:24.688298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 979/1924] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:24.707296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:24.710600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:24.756226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:24.756986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.757274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.757555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.758752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:24.767098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:24.799440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 946/1925] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:24.806884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:24.848165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e229598-2031-47c8-9224-58c0bde38337 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:24.858179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:24.859166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4f98f-7724-4a2b-9957-ec7ca0ae881d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:24.859488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.859891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.860359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.861794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:24.865345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:24.867059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01e24-ed07-4549-a587-227c22bd7167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:24.868089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01e24-ed07-4549-a587-227c22bd7167 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.869867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01e24-ed07-4549-a587-227c22bd7167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.869867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01e24-ed07-4549-a587-227c22bd7167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.883317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 947/1926] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:24.891919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:24.894354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f01e24-ed07-4549-a587-227c22bd7167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:24.898010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f01e24-ed07-4549-a587-227c22bd7167 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:24.913248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b76dd0-1709-4e72-bfe5-72648de0b103 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:24.919932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 980/1927] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:24.925713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:24.927595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:24.928097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:24.928590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] PATH_INFO: `/v3/projects/3d809788b8d34c6ab0ec540cc741a2b2/users/742474c1c2ad4f6ea171983ed1b78840/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:24.939597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:24.964366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d809788b8d34c6ab0ec540cc741a2b2, user_id=742474c1c2ad4f6ea171983ed1b78840, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:24.987767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:25.108302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 948/1928] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:24 2022] PUT /identity/v3/projects/3d809788b8d34c6ab0ec540cc741a2b2/users/742474c1c2ad4f6ea171983ed1b78840/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:25.137005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:25.137605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:25.144411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:25.166152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:25.277072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] MFA Rules not processed for user `742474c1c2ad4f6ea171983ed1b78840`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:25.279762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:25.619364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 981/1929] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:25.628263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:25.843116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611b091-ab1d-428c-8d1b-dc34cfe61129 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:25.855434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:25.857963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:25.858874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:25.859481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:25.861409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:25.865816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:25.949893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:25.954534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:25.989841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f83e3-2d31-48ee-9da9-35eab6649c02 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:26.000320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:26.002243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:26.002840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:26.003478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] PATH_INFO: `/v3/users/d5a6526666e747ab86672b3608104453` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:26.006418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a6526666e747ab86672b3608104453)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:26.012288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:26.086311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 949/1930] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:25 2022] POST /identity/v3/projects => generated 383 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:26.092530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:26.221334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:26.269974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2434-1ed5-4728-b41e-7fdf11a6ae01 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:26.278086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:26.279002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:26.279306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:26.279646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:26.280367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:26.283041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:26.411250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a6526666e747ab86672b3608104453'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.419121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 950/1931] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:26 2022] POST /identity/v3/users => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:26.419121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:26.422975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:26.444987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba85f6-ac08-4dce-9b7c-353705d3c7bb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:26.457312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:26.458927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:26.459433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:26.459914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] PATH_INFO: `/v3/projects/c382424235bd4a8d8e2ddd15995b1bd6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:26.466737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c382424235bd4a8d8e2ddd15995b1bd6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:26.471083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:26.483259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a6526666e747ab86672b3608104453'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.484356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a6526666e747ab86672b3608104453'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.498799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a6526666e747ab86672b3608104453'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.501358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a6526666e747ab86672b3608104453'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.557733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 982/1932] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:25 2022] DELETE /identity/v3/users/d5a6526666e747ab86672b3608104453 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:26.557733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:26.559837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:26.685082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1e5d2-e37e-49a0-951b-aac6bb37b3bd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:26.694097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00578041-799a-42ca-aa1d-5e1d5c49f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:26.694990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00578041-799a-42ca-aa1d-5e1d5c49f013 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:26.695403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00578041-799a-42ca-aa1d-5e1d5c49f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:26.695807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00578041-799a-42ca-aa1d-5e1d5c49f013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:26.698640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00578041-799a-42ca-aa1d-5e1d5c49f013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:26.702199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00578041-799a-42ca-aa1d-5e1d5c49f013 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:26.729411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 983/1933] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:26.733630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f40b9-f4ee-49cb-a13d-3cff6a4ad16d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:26.733969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f40b9-f4ee-49cb-a13d-3cff6a4ad16d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:26.736578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f40b9-f4ee-49cb-a13d-3cff6a4ad16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:26.770285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bc5f40b9-f4ee-49cb-a13d-3cff6a4ad16d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:26.778084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc5f40b9-f4ee-49cb-a13d-3cff6a4ad16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:26.780178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c382424235bd4a8d8e2ddd15995b1bd6', 'request_id': 'req-d7d47506-3b38-45b1-ae62-35f0892c3d6d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.795971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c382424235bd4a8d8e2ddd15995b1bd6', 'request_id': 'req-d7d47506-3b38-45b1-ae62-35f0892c3d6d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.821540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c382424235bd4a8d8e2ddd15995b1bd6', 'request_id': 'req-d7d47506-3b38-45b1-ae62-35f0892c3d6d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.879675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:26.919844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] The token cache is being invalidate because project c382424235bd4a8d8e2ddd15995b1bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:26.920128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.920917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:26.926940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 951/1934] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:26 2022] DELETE /identity/v3/projects/c382424235bd4a8d8e2ddd15995b1bd6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:26.928152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:26.929806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:26.946905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 984/1935] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:26.948985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5961-8765-4df0-a127-87598df2665c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:26.949666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5961-8765-4df0-a127-87598df2665c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:26.950216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5961-8765-4df0-a127-87598df2665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:26.976618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cbef5961-8765-4df0-a127-87598df2665c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:26.980400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cbef5961-8765-4df0-a127-87598df2665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:27.001858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 985/1936] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:27.003878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5961-8765-4df0-a127-87598df2665c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.006915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cbef5961-8765-4df0-a127-87598df2665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:27.086102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47506-3b38-45b1-ae62-35f0892c3d6d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:27.092042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:27.093422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.093824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.094109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] PATH_INFO: `/v3/projects/dfae6510e28e4561abdf7ae535c8a082/users/ab8602dc73b44c04b1f0255ae44fa3f3/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.122350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfae6510e28e4561abdf7ae535c8a082, user_id=ab8602dc73b44c04b1f0255ae44fa3f3, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:27.125752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:27.198059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5961-8765-4df0-a127-87598df2665c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:27.206662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410003d-5730-4ebc-8269-022d642c56dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:27.207323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410003d-5730-4ebc-8269-022d642c56dd service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.208751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410003d-5730-4ebc-8269-022d642c56dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.208751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410003d-5730-4ebc-8269-022d642c56dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.232840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410003d-5730-4ebc-8269-022d642c56dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:27.232840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410003d-5730-4ebc-8269-022d642c56dd service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:27.263869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 986/1937] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:27.263869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b79c3-9d05-484f-908c-a189224251e6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.263869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b79c3-9d05-484f-908c-a189224251e6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.263869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b79c3-9d05-484f-908c-a189224251e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.279909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 952/1938] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:26 2022] PUT /identity/v3/projects/dfae6510e28e4561abdf7ae535c8a082/users/ab8602dc73b44c04b1f0255ae44fa3f3/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:27.281373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.298703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-234b79c3-9d05-484f-908c-a189224251e6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:27.301583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-234b79c3-9d05-484f-908c-a189224251e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:27.381409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c90c7-47c3-41e5-8008-6b8d82617d11 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:27.389593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:27.390764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.391270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.392817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.393845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:27.396051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:27.426093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 953/1939] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:27.427897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.441529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5460e3-57c6-41e6-a3e8-dac7ca5548e0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:27.461722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:27.463786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.464236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.464681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] PATH_INFO: `/v3/projects/dfae6510e28e4561abdf7ae535c8a082/users/ab8602dc73b44c04b1f0255ae44fa3f3/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.470916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfae6510e28e4561abdf7ae535c8a082, user_id=ab8602dc73b44c04b1f0255ae44fa3f3, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:27.474898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:27.494601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 954/1940] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:27 2022] PUT /identity/v3/projects/dfae6510e28e4561abdf7ae535c8a082/users/ab8602dc73b44c04b1f0255ae44fa3f3/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:27.497725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 987/1941] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:27.501946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.505936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.506145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.506388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.542568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] MFA Rules not processed for user `ab8602dc73b44c04b1f0255ae44fa3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:27.543890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:27.698906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee07c8-93a0-41a5-bccb-531b70cd2a35 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:27.713448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:27.714195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.714696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.715168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.717150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:27.717753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:27.722486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:27.755394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 955/1942] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:27.763262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.786242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 988/1943] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:27.813603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370b671-5d37-4e2f-86ef-3daf65a19eb6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:27.816712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:27.825215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:27.828914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:27.828914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:27.828914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:27.828914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:27.830079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:27.839003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.842763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:27.934650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 956/1944] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:27 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:27.938103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:27.971136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d2560-a7e5-44f5-9e51-ce7ae6eb4db1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:28.046806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46426011-2196-4909-b917-b5d2ef275bfb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:28.052057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:28.057026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:28.062563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:28.062563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:28.062563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:28.062563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:28.062563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:28.115863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:28.117177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:28.117808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:28.118882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:28.211709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 957/1945] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:27 2022] POST /identity/v3/users => generated 288 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:28.217496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:28.230007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b45e-4473-40c9-a331-a48e4a4918d0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:28.239844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:28.240531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:28.240831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:28.241110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:28.241881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:28.242930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:28.245741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:28.246008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:28.273877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 958/1946] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:18:28.274199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 989/1947] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:28.279425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:28.285999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:28.292295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:28.298123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cda1f-16dd-434b-88d6-1e70aae2a7bc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:28.306442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:28.307748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:28.308168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:28.308541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:28.312463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:28.315494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:28.335987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 959/1948] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:28.634343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dc500-fb3c-49d0-b454-78d58b6b267e service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:28.637350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:28.638521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:28.638521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:28.638521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:28.638521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] PATH_INFO: `/v3/projects/95c63924c42e477e81db95116934b29e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:28.639597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c63924c42e477e81db95116934b29e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:28.639766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bc0b3-bc29-4b18-893a-e2a39f972c39 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:28.639873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:28.639952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:28.639952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:28.639952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:28.639952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] PATH_INFO: `/v3/projects/b684c4a62ba24a9c8b1864c879faa936/users/6e6faad2a32645df86b9c84ff6e67b51/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:28.640307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b684c4a62ba24a9c8b1864c879faa936, user_id=6e6faad2a32645df86b9c84ff6e67b51, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:28.640307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:28.640486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:29.047969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 960/1949] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:28 2022] PUT /identity/v3/projects/b684c4a62ba24a9c8b1864c879faa936/users/6e6faad2a32645df86b9c84ff6e67b51/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:29.052484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:29.052484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:29.124320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c63924c42e477e81db95116934b29e', 'request_id': 'req-067d5858-f765-45de-b41f-d2014e2fe6cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.146880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a2c42-cae1-4c7f-a9dc-69bd8f2164a8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:29.257804 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:29.259274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:29.259768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:29.260342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] PATH_INFO: `/v3/users/762912d8515f45c79faaa3f8094597b3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:29.262152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] RBAC: Authorizing `identity:delete_user(user_id=762912d8515f45c79faaa3f8094597b3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:29.265215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:29.272066 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c63924c42e477e81db95116934b29e', 'request_id': 'req-067d5858-f765-45de-b41f-d2014e2fe6cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.282223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c63924c42e477e81db95116934b29e', 'request_id': 'req-067d5858-f765-45de-b41f-d2014e2fe6cf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.300550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] The token cache is being invalidate because project 95c63924c42e477e81db95116934b29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:29.300920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.301735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-067d5858-f765-45de-b41f-d2014e2fe6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.303549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 990/1950] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:28 2022] DELETE /identity/v3/projects/95c63924c42e477e81db95116934b29e => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:29.305283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:29.305732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:29.306123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:29.339799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] MFA Rules not processed for user `6e6faad2a32645df86b9c84ff6e67b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:29.341389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:29.434724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 991/1951] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:29.436134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:29.437947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:29.538899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd21ea-5c8c-41b9-96a1-6ea11122e908 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:29.545448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:29.548944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:29.548944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:29.548944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:29.550715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:29.606442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762912d8515f45c79faaa3f8094597b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.607370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762912d8515f45c79faaa3f8094597b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.608213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762912d8515f45c79faaa3f8094597b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.668438 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:29.671348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:29.689955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 992/1952] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:29.691477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:29.694026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:29.727481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d57d7-479a-4b1d-bf20-aefa294c3610 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:29.732518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762912d8515f45c79faaa3f8094597b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.736606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:29.739650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:29.739650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:29.739650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] PATH_INFO: `/v3/users/4f75d6e6bc864a95850b15940300bafd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:29.741772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f75d6e6bc864a95850b15940300bafd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:29.745279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:29.762068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762912d8515f45c79faaa3f8094597b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:29.829485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 961/1953] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:29 2022] DELETE /identity/v3/users/762912d8515f45c79faaa3f8094597b3 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:29.829485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:29.829485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:29.988839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba65c6-9b49-442e-aca2-c14ff36f743f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.007184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd75e-4cc1-47f8-8490-e835d69177ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.008586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd75e-4cc1-47f8-8490-e835d69177ad admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.009302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd75e-4cc1-47f8-8490-e835d69177ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.009966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd75e-4cc1-47f8-8490-e835d69177ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.011435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd75e-4cc1-47f8-8490-e835d69177ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.031893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd75e-4cc1-47f8-8490-e835d69177ad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:30.060068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f75d6e6bc864a95850b15940300bafd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:30.173246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f75d6e6bc864a95850b15940300bafd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:30.174318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f75d6e6bc864a95850b15940300bafd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:30.181028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 962/1954] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:29 2022] POST /identity/v3/projects => generated 375 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:30.191056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f75d6e6bc864a95850b15940300bafd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:30.193437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f75d6e6bc864a95850b15940300bafd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:30.196929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866307-7e70-42ae-bed5-07828826244c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.197294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866307-7e70-42ae-bed5-07828826244c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.197775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866307-7e70-42ae-bed5-07828826244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.246115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 993/1955] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:29 2022] DELETE /identity/v3/users/4f75d6e6bc864a95850b15940300bafd => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:30.253151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:30.260380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-03866307-7e70-42ae-bed5-07828826244c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:30.264776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-03866307-7e70-42ae-bed5-07828826244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:30.266452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:30.448562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 963/1956] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:30.449633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1489c4-128a-438f-93de-9935d95d188d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.460011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.460756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.461089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.461376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.463426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.466058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866307-7e70-42ae-bed5-07828826244c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:30.466322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:30.468573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-03866307-7e70-42ae-bed5-07828826244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:30.528523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:30.576033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866307-7e70-42ae-bed5-07828826244c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.582122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.583295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.583753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.584387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.599095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.601652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:30.619537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 964/1957] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:30.691970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 994/1958] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:30 2022] POST /identity/v3/users => generated 288 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:30.698442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:30.715567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecf387-bd05-4954-a092-c850aca93c85 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.729168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.730856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.731149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.731533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.733749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.737007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:30.773822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 965/1959] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:30.778146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:30.791485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:30.795242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:30.807175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e682-1374-4bf0-afac-c837971f92b1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.810418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:30.819459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ac8ff-255d-41d7-b0f6-adf424be39de admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.826123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.827126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.827636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.828042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] PATH_INFO: `/v3/users/742474c1c2ad4f6ea171983ed1b78840` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.829578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=742474c1c2ad4f6ea171983ed1b78840)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.832604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:30.843957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.845835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.845835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.846360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.847788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.851378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:30.877806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 995/1960] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:30.882793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:30.910940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247c1d9-f0d3-4a51-bb68-80a10ebd86cb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:30.919150 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:30.920591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:30.921060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:30.921498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] PATH_INFO: `/v3/projects/9394a764b4d84c0390ed84c0a0f17e0a/users/66c0dc5f65f646fbb652d66ddda758b0/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:30.941679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9394a764b4d84c0390ed84c0a0f17e0a, user_id=66c0dc5f65f646fbb652d66ddda758b0, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:30.944721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:31.131213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 996/1961] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:30 2022] PUT /identity/v3/projects/9394a764b4d84c0390ed84c0a0f17e0a/users/66c0dc5f65f646fbb652d66ddda758b0/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:31.132441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:31.147831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:31.270443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c288c-2348-439f-a795-51f685dcef66 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:31.281573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:31.282918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:31.283408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:31.283874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] PATH_INFO: `/v3/projects/a1c83fb020fe436b8a7c78b71e3236e0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:31.286276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c83fb020fe436b8a7c78b71e3236e0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:31.289481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:31.326804 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742474c1c2ad4f6ea171983ed1b78840'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.328438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742474c1c2ad4f6ea171983ed1b78840'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.330335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742474c1c2ad4f6ea171983ed1b78840'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.479054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742474c1c2ad4f6ea171983ed1b78840'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.520705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-547e1cbc-ce1c-4359-89ab-59e130cfb6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742474c1c2ad4f6ea171983ed1b78840'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.521332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c83fb020fe436b8a7c78b71e3236e0', 'request_id': 'req-bc206c12-ed5a-48fb-a219-e591f6da20ef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.537836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 966/1962] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:30 2022] DELETE /identity/v3/users/742474c1c2ad4f6ea171983ed1b78840 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:31.539889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:31.540603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:31.541150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:31.579480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] MFA Rules not processed for user `66c0dc5f65f646fbb652d66ddda758b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:31.580741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:31.641788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c83fb020fe436b8a7c78b71e3236e0', 'request_id': 'req-bc206c12-ed5a-48fb-a219-e591f6da20ef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.659869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c83fb020fe436b8a7c78b71e3236e0', 'request_id': 'req-bc206c12-ed5a-48fb-a219-e591f6da20ef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.669074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 967/1963] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:31.670757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:31.673070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:31.676778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] The token cache is being invalidate because project a1c83fb020fe436b8a7c78b71e3236e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:31.677158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.677925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bc206c12-ed5a-48fb-a219-e591f6da20ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.679732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 997/1964] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:31 2022] DELETE /identity/v3/projects/a1c83fb020fe436b8a7c78b71e3236e0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:31.684883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:31.684883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:31.684883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:31.705213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:31.706634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:31.787529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b2c00-2a01-48e2-907a-1e86e35609b8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:31.807057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 998/1965] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:31.807057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:31.807337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:31.807490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:31.807625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:31.807625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:31.807900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] PATH_INFO: `/v3/projects/d2248a64e1f44ec48f83745a11e639d0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:31.809366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2248a64e1f44ec48f83745a11e639d0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:31.811670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:31.835937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667503-5475-4677-a4b5-a556658c5b29 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:31.844697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983b4c-99ea-468f-824a-5dd66fcb5c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:31.845812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983b4c-99ea-468f-824a-5dd66fcb5c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:31.848968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983b4c-99ea-468f-824a-5dd66fcb5c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:31.848968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983b4c-99ea-468f-824a-5dd66fcb5c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:31.848968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84983b4c-99ea-468f-824a-5dd66fcb5c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:31.852610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84983b4c-99ea-468f-824a-5dd66fcb5c7b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:31.954295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:31.965218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 999/1966] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:31 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:31.966624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:31.966942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:31.967414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:31.980511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2248a64e1f44ec48f83745a11e639d0', 'request_id': 'req-c52bc21f-4a1b-40e1-80ea-878d7a37386a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.990172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2248a64e1f44ec48f83745a11e639d0', 'request_id': 'req-c52bc21f-4a1b-40e1-80ea-878d7a37386a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:31.994877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:31.994877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.006768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2248a64e1f44ec48f83745a11e639d0', 'request_id': 'req-c52bc21f-4a1b-40e1-80ea-878d7a37386a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.080774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1000/1967] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:32.081718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.083578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.110369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] The token cache is being invalidate because project d2248a64e1f44ec48f83745a11e639d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:32.111282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.112808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.116239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 968/1968] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:31 2022] DELETE /identity/v3/projects/d2248a64e1f44ec48f83745a11e639d0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:32.119369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.122586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.175128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518a626-44e4-47e3-8cbf-b48743cbe433 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.181473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.182792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.183250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.183575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.186748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.211269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.214677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb6a26-dbbd-417c-977d-302c1657e414 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.246213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1001/1969] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:32.249347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:32.256271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.256271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.256271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.264768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bc21f-4a1b-40e1-80ea-878d7a37386a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.273762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.276123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.276917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.277353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.278315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.280633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.282812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:32.284190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.296135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1002/1970] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:32.297210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.298971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.315968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf248a0-a410-4566-9807-214b4f91ea90 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.330769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.332290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.332800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.333395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] PATH_INFO: `/v3/users/4ffe4f56fd184fec94cf06b83ebb4305` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.335779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffe4f56fd184fec94cf06b83ebb4305)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.339614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.403841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 969/1971] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:32 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:32.409851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.435079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aff190-20fa-484b-ac0d-5d34fa8128ac admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.441215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.442047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.442388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.442726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.443713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:32.444095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.446372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.467327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 970/1972] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:32.468379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.483423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6b096-c0b6-49d2-9285-014397a327f3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.491841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.493589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.494081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.494561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.496310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.499334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.518756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 971/1973] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:32.520446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.539838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdf9fc-b4b0-4233-bf81-662310fdd041 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.554975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.556422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.557073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.557633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.559109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.563189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.683830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffe4f56fd184fec94cf06b83ebb4305'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.704992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 972/1974] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:32 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:32.706487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.812323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffe4f56fd184fec94cf06b83ebb4305'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.815697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffe4f56fd184fec94cf06b83ebb4305'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.816260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ff63e-b04e-4b42-89ac-0d537b58bada admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:32.823455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:32.824776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:32.825255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:32.825712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] PATH_INFO: `/v3/projects/e5b0b09954af46088f9a25a09a62a6f6/users/fe7dd09020f64333900d8a6e2634e841/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:32.835777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffe4f56fd184fec94cf06b83ebb4305'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.838717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffe4f56fd184fec94cf06b83ebb4305'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:32.850183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b0b09954af46088f9a25a09a62a6f6, user_id=fe7dd09020f64333900d8a6e2634e841, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:32.856678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:32.902377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1003/1975] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:32 2022] DELETE /identity/v3/users/4ffe4f56fd184fec94cf06b83ebb4305 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:32.902377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.902377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:32.974047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 973/1976] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:32 2022] PUT /identity/v3/projects/e5b0b09954af46088f9a25a09a62a6f6/users/fe7dd09020f64333900d8a6e2634e841/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:32.978981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:32.981305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:33.014035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a41e0-9d3d-497f-aa78-648d21664514 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.082171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78490b89-2a40-425f-b997-d8739366b074 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.088091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.089081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.089450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.095584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.095584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.095952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.095952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.095952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.095952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.096566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.096733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.096733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.112421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 974/1977] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:18:33.116934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:33.121016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:33.139935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e42aa3-7aa5-4e97-8247-759a5d1fb987 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.147221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.148289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.148446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.148672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] PATH_INFO: `/v3/projects/3d809788b8d34c6ab0ec540cc741a2b2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.150978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d809788b8d34c6ab0ec540cc741a2b2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.153357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.290490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1004/1978] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:32 2022] POST /identity/v3/users => generated 282 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:33.292237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:33.313491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05471a9c-ad60-4761-a90f-865592738457 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.323891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.325273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.325677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.326070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] PATH_INFO: `/v3/projects/e5b0b09954af46088f9a25a09a62a6f6/users/fe7dd09020f64333900d8a6e2634e841/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.329460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b0b09954af46088f9a25a09a62a6f6, user_id=fe7dd09020f64333900d8a6e2634e841, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.334097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.364239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1005/1979] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:33 2022] PUT /identity/v3/projects/e5b0b09954af46088f9a25a09a62a6f6/users/fe7dd09020f64333900d8a6e2634e841/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:33.366464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:33.379823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d809788b8d34c6ab0ec540cc741a2b2', 'request_id': 'req-214d5be6-84e1-48ce-adcc-3f1b10a6c436'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:33.399559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d809788b8d34c6ab0ec540cc741a2b2', 'request_id': 'req-214d5be6-84e1-48ce-adcc-3f1b10a6c436'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:33.419443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d809788b8d34c6ab0ec540cc741a2b2', 'request_id': 'req-214d5be6-84e1-48ce-adcc-3f1b10a6c436'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:33.523320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0107ad-0c8a-499c-b0dc-47c7281ed367 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.577630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] The token cache is being invalidate because project 3d809788b8d34c6ab0ec540cc741a2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:33.578625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:33.581007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-214d5be6-84e1-48ce-adcc-3f1b10a6c436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:33.594426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 975/1980] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:33 2022] DELETE /identity/v3/projects/3d809788b8d34c6ab0ec540cc741a2b2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:33.597061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b502-0422-4288-8398-41853093e602 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.597580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b502-0422-4288-8398-41853093e602 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.598103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411b502-0422-4288-8398-41853093e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.651710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.652416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.652740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.653057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.653912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.656035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.676533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1006/1981] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:33.676533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:33.676993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:33.684558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b411b502-0422-4288-8398-41853093e602 None None] MFA Rules not processed for user `fe7dd09020f64333900d8a6e2634e841`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:33.686977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b411b502-0422-4288-8398-41853093e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:33.691899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a621b1a-8984-4e43-8ffa-cd491f78adbf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.697408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.698403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.698699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.698978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] PATH_INFO: `/v3/users/ab8602dc73b44c04b1f0255ae44fa3f3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.700451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8602dc73b44c04b1f0255ae44fa3f3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.702353 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.785724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 976/1982] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:33.786613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b502-0422-4288-8398-41853093e602 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:33.788010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b411b502-0422-4288-8398-41853093e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:33.803502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411b502-0422-4288-8398-41853093e602 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.808765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.809487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.809770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.810047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.810820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:33.812478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:33.824108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 977/1983] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:33.829394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:33.829394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:33.922710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb3344-48fa-454e-9466-eb4ab4e08728 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:33.927413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:33.928467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:33.928740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:33.929009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:33.932290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:34.002571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8602dc73b44c04b1f0255ae44fa3f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.032397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:34.034536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:34.048389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 978/1984] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:34.049825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:34.072284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068a015-27c2-49bf-a20f-5bb99e8ea7db service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:34.081142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50c366-7890-488b-94f4-6fb7631bd7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:34.082398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c366-7890-488b-94f4-6fb7631bd7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:34.082864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c366-7890-488b-94f4-6fb7631bd7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:34.083343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50c366-7890-488b-94f4-6fb7631bd7f3 admin admin] PATH_INFO: `/v3/projects/0b9e2cf1a4dc4dc2be51bd45d4a1c6b8/users/9fd24a9da7ca4fa8a156d59369480f8a/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:34.118988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c366-7890-488b-94f4-6fb7631bd7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9e2cf1a4dc4dc2be51bd45d4a1c6b8, user_id=9fd24a9da7ca4fa8a156d59369480f8a, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:34.123154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50c366-7890-488b-94f4-6fb7631bd7f3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:34.146934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8602dc73b44c04b1f0255ae44fa3f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.150128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8602dc73b44c04b1f0255ae44fa3f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.164462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8602dc73b44c04b1f0255ae44fa3f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.165885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8602dc73b44c04b1f0255ae44fa3f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.184616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:34.205737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1007/1985] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:33 2022] DELETE /identity/v3/users/ab8602dc73b44c04b1f0255ae44fa3f3 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:34.221564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:34.221564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:34.226235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 979/1986] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:34 2022] PUT /identity/v3/projects/0b9e2cf1a4dc4dc2be51bd45d4a1c6b8/users/9fd24a9da7ca4fa8a156d59369480f8a/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:34.249031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:34.249919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:34.250632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:34.353411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] MFA Rules not processed for user `9fd24a9da7ca4fa8a156d59369480f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:34.355662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:34.370547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f176-a766-4205-a2d9-c8fee5e31017 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:34.385932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:34.519391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:34.521178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:34.521683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:34.522176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] PATH_INFO: `/v3/projects/6568213c61ed45d088585d8adef034fe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:34.525899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6568213c61ed45d088585d8adef034fe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:34.531056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:34.547697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 980/1987] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:34.557508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:34.560129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:34.587291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef973c31-e2bc-4ef8-8520-5f852cf96da3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:34.596150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:34.597475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:34.598048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:34.598604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:34.599949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:34.604459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:34.729988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6568213c61ed45d088585d8adef034fe', 'request_id': 'req-9a78f47f-6542-4f6e-a964-4f56004af680'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.928612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 981/1988] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:34 2022] POST /identity/v3/projects => generated 363 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:34.934899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:34.942389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6568213c61ed45d088585d8adef034fe', 'request_id': 'req-9a78f47f-6542-4f6e-a964-4f56004af680'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:34.966343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6568213c61ed45d088585d8adef034fe', 'request_id': 'req-9a78f47f-6542-4f6e-a964-4f56004af680'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.010602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] The token cache is being invalidate because project 6568213c61ed45d088585d8adef034fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:35.011275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.012877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a78f47f-6542-4f6e-a964-4f56004af680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.016274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1008/1989] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:34 2022] DELETE /identity/v3/projects/6568213c61ed45d088585d8adef034fe => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:35.024613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.026190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.035270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.068475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:35.075582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.101578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de2fa7-27ed-4553-b85f-8013ddca7091 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:35.108546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b71b0-1ef6-447c-93af-40f60092e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:35.109291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b71b0-1ef6-447c-93af-40f60092e855 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.109571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b71b0-1ef6-447c-93af-40f60092e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.110145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b71b0-1ef6-447c-93af-40f60092e855 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.122280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b71b0-1ef6-447c-93af-40f60092e855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:35.131042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b71b0-1ef6-447c-93af-40f60092e855 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:35.200696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1009/1990] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:35.202110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.203360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.216626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d12f84-bbca-43bc-8831-e914694cb9b2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:35.222197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:35.223368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.223765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.224177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] PATH_INFO: `/v3/projects/dfae6510e28e4561abdf7ae535c8a082` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.226363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfae6510e28e4561abdf7ae535c8a082)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:35.229579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:35.287350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 982/1991] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:34 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:35.291303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.292429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.293158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.346403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:35.352089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.374658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 983/1992] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:35.383414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.384886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.410232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de9c86-f26a-48a0-960d-4f466c36d777 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:35.420431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:35.421889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.422413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.422975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.424430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:35.427920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:35.450998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 984/1993] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:35.452828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.477051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650cc1-d164-4821-8d69-e16abcb824dd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:35.479152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfae6510e28e4561abdf7ae535c8a082', 'request_id': 'req-00f73a59-5f53-4004-9695-3f2c3d4b5fec'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.592254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfae6510e28e4561abdf7ae535c8a082', 'request_id': 'req-00f73a59-5f53-4004-9695-3f2c3d4b5fec'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.599417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfae6510e28e4561abdf7ae535c8a082', 'request_id': 'req-00f73a59-5f53-4004-9695-3f2c3d4b5fec'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.611982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:35.613307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] The token cache is being invalidate because project dfae6510e28e4561abdf7ae535c8a082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:35.613538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.613655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.614247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.614463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:35.614996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.620829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1010/1994] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:35 2022] DELETE /identity/v3/projects/dfae6510e28e4561abdf7ae535c8a082 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:35.620829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.621103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:35.621103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:35.623947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516c87-ac68-49ef-95ba-abfff3b490a5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:35.639578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.654595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 985/1995] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:35.654595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.660214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.660214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.667507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f73a59-5f53-4004-9695-3f2c3d4b5fec admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:35.673582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278843fa-b34c-4ee9-87fe-e1a8279eec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:35.674940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278843fa-b34c-4ee9-87fe-e1a8279eec4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.675392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278843fa-b34c-4ee9-87fe-e1a8279eec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.675735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278843fa-b34c-4ee9-87fe-e1a8279eec4d admin admin] PATH_INFO: `/v3/projects/0a959a2ca3064b9ca1c5d2984f2263e8/users/65b95642366c401e97b2b3f97b89701e/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.699839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278843fa-b34c-4ee9-87fe-e1a8279eec4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a959a2ca3064b9ca1c5d2984f2263e8, user_id=65b95642366c401e97b2b3f97b89701e, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:35.700035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:35.700035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.700227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278843fa-b34c-4ee9-87fe-e1a8279eec4d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:35.716838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 986/1996] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:35.716838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.718152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.743954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef01c7-cd51-41ad-b5e1-3bb9d85dd112 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:35.758010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:35.758010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.758010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.758010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.758518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:35.760451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:35.797914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1011/1997] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:35 2022] PUT /identity/v3/projects/0a959a2ca3064b9ca1c5d2984f2263e8/users/65b95642366c401e97b2b3f97b89701e/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:35.799844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:35.803178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:35.803178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:35.823871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:35.825223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:35.876539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 987/1998] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:35 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:35.876539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.934064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1012/1999] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:35.935838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:35.955767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42045de2-a762-4a70-88f8-3b6c0990737c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.004711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df9bf0-3d7a-492c-b3e1-f7d1df61e530 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.012926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.013614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.013901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.014186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.014944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.016598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.030910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 988/2000] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:36.035557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.061781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cb63d-918e-4b59-a5f9-5351d7c03565 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.073449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.074540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.074989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.075584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.081316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:36.081732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.085077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.096063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fcd01-ac5f-418c-936d-a911ddfcf7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.097826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fcd01-ac5f-418c-936d-a911ddfcf7cc admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.099231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fcd01-ac5f-418c-936d-a911ddfcf7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.100110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fcd01-ac5f-418c-936d-a911ddfcf7cc admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.101882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fcd01-ac5f-418c-936d-a911ddfcf7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.108127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fcd01-ac5f-418c-936d-a911ddfcf7cc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.117676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 989/2001] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:36.117676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.134151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7788-3166-400e-9e0b-b10176b9872f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.139892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.141096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.141485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.141884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] PATH_INFO: `/v3/projects/0a959a2ca3064b9ca1c5d2984f2263e8/users/65b95642366c401e97b2b3f97b89701e/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.144174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a959a2ca3064b9ca1c5d2984f2263e8, user_id=65b95642366c401e97b2b3f97b89701e, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.147389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.163512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 990/2002] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:36 2022] PUT /identity/v3/projects/0a959a2ca3064b9ca1c5d2984f2263e8/users/65b95642366c401e97b2b3f97b89701e/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:36.175272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.257793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1013/2003] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:35 2022] POST /identity/v3/users => generated 284 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:36.259874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.260312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.260778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.284914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b9a86-07d0-438d-a9ad-90e15779ddc0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.294773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.296355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.296984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.297672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.299061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.303181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.306822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] MFA Rules not processed for user `65b95642366c401e97b2b3f97b89701e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:36.309246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:36.330983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:36.451415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 991/2004] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:36 2022] POST /identity/v3/projects => generated 383 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:36.452912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.473965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1014/2005] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:36.475497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.501592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a5e4-86cc-4661-98ab-ef3b68e06604 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.577542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28753b-9d98-41e7-9251-478c38c83bdd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.582712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:36.588525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.589581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.589919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.590138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.591026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.592993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.607467 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 992/2006] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:36.609675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.611195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:36.622700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.623663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.624856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.624856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.625756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.629719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.715529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69896311-072b-422c-9cec-1cac983ea66d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.721457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.722448 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.722979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.723519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.857088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.861239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1015/2007] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:36 2022] POST /identity/v3/users => generated 292 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:36.861508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.861605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.886576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 993/2008] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:36.886576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.908613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c2ace-94c3-46e9-9b41-c816f3716305 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.912410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afb92c-2605-446d-a4be-7900c58a4c97 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.917754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.920432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.920901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.921314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.922287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.925504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.934401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.937966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.937966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.937966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.937966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:36.938452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:36.948583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 994/2009] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:36.954667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1016/2010] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:36.962414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.963956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:36.976480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a4d8-2b5b-4392-8df5-5209447a2a91 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.984203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:36.987030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:36.989836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e81c5b-8583-44c8-90a3-50c059d777c4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:36.998022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:36.999814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:36.999953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.000225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] PATH_INFO: `/v3/projects/233a9a0ddff24e578698d3ae8bc92a4c/users/63aaae891c8d45d994e66d584945023e/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.002228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.008283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:37.043818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 995/2011] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:37.051073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233a9a0ddff24e578698d3ae8bc92a4c, user_id=63aaae891c8d45d994e66d584945023e, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.051510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:37.055247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:37.073405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4f3a9-2b5c-4822-b058-ceaf07a5a1cf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:37.109052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a86bf-3889-4aa2-8152-7d693a076962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:37.110985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a86bf-3889-4aa2-8152-7d693a076962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.111697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a86bf-3889-4aa2-8152-7d693a076962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.112368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a86bf-3889-4aa2-8152-7d693a076962 admin admin] PATH_INFO: `/v3/projects/1c4603fbe7534257a40a5dc0ae0c4404/users/ca949d66e8da4cc1816f37082bf671b3/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.170636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a86bf-3889-4aa2-8152-7d693a076962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4603fbe7534257a40a5dc0ae0c4404, user_id=ca949d66e8da4cc1816f37082bf671b3, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.173977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a86bf-3889-4aa2-8152-7d693a076962 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:37.198143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1017/2012] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:36 2022] PUT /identity/v3/projects/233a9a0ddff24e578698d3ae8bc92a4c/users/63aaae891c8d45d994e66d584945023e/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:37.199065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:37.205021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:37.284968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 996/2013] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:37 2022] PUT /identity/v3/projects/1c4603fbe7534257a40a5dc0ae0c4404/users/ca949d66e8da4cc1816f37082bf671b3/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:37.286927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.297199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.297199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.319459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] MFA Rules not processed for user `63aaae891c8d45d994e66d584945023e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:37.321523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:37.324817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee53c2-243e-4f39-938f-a05d51d848a8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:37.383447 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:37.384539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.384919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.385247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.387625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:37.405120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 997/2014] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:37.407067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:37.420558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3bc19-266e-41ab-956f-5c2ccc9e7667 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:37.425023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:37.425831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.426124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.426400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.428309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:37.499708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.501982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf2751-2d44-44af-b1dc-6b7efaca3ef5 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:37.524038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1018/2015] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:37.527565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373632-1d85-4034-8674-5214601bb3ce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.528079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373632-1d85-4034-8674-5214601bb3ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.528399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.528560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373632-1d85-4034-8674-5214601bb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.530281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:37.542704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 998/2016] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:37.556362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:37.597860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:37.630527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-18373632-1d85-4034-8674-5214601bb3ce None None] MFA Rules not processed for user `ca949d66e8da4cc1816f37082bf671b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:37.632978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18373632-1d85-4034-8674-5214601bb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:37.679034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b73ae-cbc7-4d36-872a-bb7e2da03c35 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:37.704754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:37.705526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.705807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.706516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.707268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.709853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:37.745648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1019/2017] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:37.869244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 999/2018] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:37 2022] POST /identity/v3/projects => generated 365 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:37.874277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18373632-1d85-4034-8674-5214601bb3ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:37.887285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18373632-1d85-4034-8674-5214601bb3ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:37.921816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:37.988672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:37.989723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:37.990137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:37.990564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:37.991667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:37.994776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.109107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.206256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1020/2019] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:37 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:38.212442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.215389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3546af9-ab5c-44c0-a76d-aad4ca01a2cf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:38.222365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:38.223496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.225941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.225941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.245116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95d3f5-162e-485c-812c-4c25c08f93a3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:38.272538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:38.273653 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.276001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.276516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.277890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:38.281213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.307132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1021/2020] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:38.308526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.340930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e09f-5513-430b-95aa-ae2c3003442c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:38.349158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:38.350609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.351076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.351534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] PATH_INFO: `/v3/projects/7267cecf771440a0bb4c1ce4787ee310/users/c3fe64e20bd7460da209e037403869cd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.365685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:38.369706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.388246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7267cecf771440a0bb4c1ce4787ee310, user_id=c3fe64e20bd7460da209e037403869cd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:38.393866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.398115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1000/2021] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:38.424900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.450610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbad442-25b8-47e3-8122-c752ef263ea9 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:38.460053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:38.461687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.462174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.471187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] PATH_INFO: `/v3/users/ca949d66e8da4cc1816f37082bf671b3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.471187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca949d66e8da4cc1816f37082bf671b3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:38.471848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.509923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1022/2022] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:38 2022] PUT /identity/v3/projects/7267cecf771440a0bb4c1ce4787ee310/users/c3fe64e20bd7460da209e037403869cd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:38.514781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.629484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb75e-8cdd-4370-aa6d-a6684c07c5de admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:38.637298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:38.638004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.638287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.638667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.639865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:38.641730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.644510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:38.660160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1023/2023] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:38.666577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.685415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c06dc3-9c97-44f7-8774-e912b3bc1476 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:38.691630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616ea7e-16de-46e7-b67f-ab3687266589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:38.700258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ea7e-16de-46e7-b67f-ab3687266589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.700258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ea7e-16de-46e7-b67f-ab3687266589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.700258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616ea7e-16de-46e7-b67f-ab3687266589 admin admin] PATH_INFO: `/v3/projects/7267cecf771440a0bb4c1ce4787ee310/users/c3fe64e20bd7460da209e037403869cd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.700258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ea7e-16de-46e7-b67f-ab3687266589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7267cecf771440a0bb4c1ce4787ee310, user_id=c3fe64e20bd7460da209e037403869cd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:38.700258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616ea7e-16de-46e7-b67f-ab3687266589 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:38.717501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1024/2024] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:38 2022] PUT /identity/v3/projects/7267cecf771440a0bb4c1ce4787ee310/users/c3fe64e20bd7460da209e037403869cd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:38.736096 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.736559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.737070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:38.787929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] MFA Rules not processed for user `c3fe64e20bd7460da209e037403869cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:38.790585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:38.829472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca949d66e8da4cc1816f37082bf671b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:38.830304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca949d66e8da4cc1816f37082bf671b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:38.830935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca949d66e8da4cc1816f37082bf671b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:38.887652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1025/2025] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:38.932068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca949d66e8da4cc1816f37082bf671b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:38.963147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1fe4be36-65b7-4200-9126-03b626d5eeec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca949d66e8da4cc1816f37082bf671b3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:38.986969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:38.988619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:38.989189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1001/2026] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:38 2022] DELETE /identity/v3/users/ca949d66e8da4cc1816f37082bf671b3 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:38.997091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:38.997658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:38.998201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:39.045789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:39.048163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:39.051892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:39.098794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16ba9c-8d89-4e69-a174-f380f45ebce1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:39.155190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1002/2027] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:39.169898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:39.170268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:39.170957 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:39.171351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:39.171759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:39.171997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:39.270190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:39.272820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:39.287799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1026/2028] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:39.312323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed723f-d22a-48c4-9f23-bc56e9835b77 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:39.316665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:39.325789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:39.325789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:39.325789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:39.331642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:39.333719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:39.347080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1003/2029] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:39.967689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:39.969188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:39.981410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061973f-2f1e-4e0c-9b3d-4995032ccc4c service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:39.985508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:39.986175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:39.986452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:39.986724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:39.992349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:40.072668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:40.075444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fdf4c-4a7b-47c3-81d7-a8394d7902a6 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:40.090963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1027/2030] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:40.104850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:40.106399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:40.122530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d362711-9a24-44d7-9290-75b257d6d9a8 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:40.132833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:40.135282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:40.135807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:40.136258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] PATH_INFO: `/v3/projects/1c4603fbe7534257a40a5dc0ae0c4404` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:40.138455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4603fbe7534257a40a5dc0ae0c4404)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:40.140399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:40.202228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:40.411521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4603fbe7534257a40a5dc0ae0c4404', 'request_id': 'req-410caabc-bd43-4817-942b-3cc41c4b2043'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:40.418715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:40.424948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4603fbe7534257a40a5dc0ae0c4404', 'request_id': 'req-410caabc-bd43-4817-942b-3cc41c4b2043'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:40.434037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4603fbe7534257a40a5dc0ae0c4404', 'request_id': 'req-410caabc-bd43-4817-942b-3cc41c4b2043'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:40.568240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] The token cache is being invalidate because project 1c4603fbe7534257a40a5dc0ae0c4404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:40.570314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:40.570314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-410caabc-bd43-4817-942b-3cc41c4b2043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:40.571028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1004/2031] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:40 2022] DELETE /identity/v3/projects/1c4603fbe7534257a40a5dc0ae0c4404 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:40.577161 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:40.577601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:40.578055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:40.613168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:40.614457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:40.713194 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1028/2032] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:40.724693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:40.725260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:40.725776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:40.759275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:40.761292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:40.776446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1005/2033] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:40.782923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:40.798424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf097b5-9a8c-435e-805b-bb035f0a5da7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:40.806924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:40.808122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:40.808657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:40.809085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:40.810213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:40.810787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:40.812889 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:40.843871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1029/2034] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:40.845860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:40.863191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b102ad-2ba6-4e54-a833-c57c321aa870 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:40.871598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:40.872744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:40.873294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:40.873802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:40.875065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:40.878920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:41.015281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1006/2035] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:40 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:41.017885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:41.043541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a43ad9-a0a1-4ad2-8f60-2b802f55b67d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:41.168711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:41.170704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:41.172837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:41.174007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:41.174518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:41.175019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:41.176333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:41.181744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:41.272635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e5646-a56e-4356-8a4b-50248e4718a6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:41.278203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:41.278885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:41.279158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:41.279508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:41.281608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:41.355329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1030/2036] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:41 2022] POST /identity/v3/users => generated 287 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:41.358043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:41.382725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:41.385835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:41.388263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75613105-bcbe-46e0-80ee-c6caf6e08ec9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:41.403061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:41.404338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:41.404942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:41.405846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:41.406046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1007/2037] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:41.406453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:41.408566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:41.432504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1031/2038] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:41.434085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:41.450978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718405c-6332-49b8-8ee2-216bccbb76cb service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:41.456477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72707f59-345b-400f-9966-c003461422b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:41.457495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72707f59-345b-400f-9966-c003461422b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:41.457860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72707f59-345b-400f-9966-c003461422b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:41.458228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72707f59-345b-400f-9966-c003461422b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:41.459111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72707f59-345b-400f-9966-c003461422b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:41.461395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72707f59-345b-400f-9966-c003461422b5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:41.475438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1008/2039] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:41.486616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:41.500036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093802a8-8e1c-48e2-a333-5a261f3de46a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:41.505598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:41.506595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:41.507006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:41.507345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] PATH_INFO: `/v3/projects/ef861c61382b4d03b3093b099690343d/users/d7d5f51a0cd64af4baf7e2711fbfb589/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:41.528008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef861c61382b4d03b3093b099690343d, user_id=d7d5f51a0cd64af4baf7e2711fbfb589, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:41.533043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:41.707844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1032/2040] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:41 2022] PUT /identity/v3/projects/ef861c61382b4d03b3093b099690343d/users/d7d5f51a0cd64af4baf7e2711fbfb589/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:41.720436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:41.721213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:41.721571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:41.761266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] MFA Rules not processed for user `d7d5f51a0cd64af4baf7e2711fbfb589`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:41.763548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:41.885978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1009/2041] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:42.017755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:42.020062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:42.070446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:42.134581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0af96-b50c-4db9-be39-8b9a33d4935c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:42.138682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfa804-8d3c-4186-9701-5403874eddd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:42.139503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa804-8d3c-4186-9701-5403874eddd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:42.139842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa804-8d3c-4186-9701-5403874eddd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:42.140101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfa804-8d3c-4186-9701-5403874eddd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:42.160459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfa804-8d3c-4186-9701-5403874eddd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:42.162068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfa804-8d3c-4186-9701-5403874eddd6 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:42.177922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1033/2042] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:42.201343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:42.335692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67293708-4458-40c8-bd09-f1d5b10ba563 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:42.342444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:42.343346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:42.343626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:42.343954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] PATH_INFO: `/v3/users/d7d5f51a0cd64af4baf7e2711fbfb589` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:42.345333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d5f51a0cd64af4baf7e2711fbfb589)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:42.347409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:42.456359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:42.615915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d5f51a0cd64af4baf7e2711fbfb589'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:42.617098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d5f51a0cd64af4baf7e2711fbfb589'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:42.618798 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d5f51a0cd64af4baf7e2711fbfb589'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:42.759922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d5f51a0cd64af4baf7e2711fbfb589'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:42.782862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d5f51a0cd64af4baf7e2711fbfb589'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:42.804739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1010/2043] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:42 2022] DELETE /identity/v3/users/d7d5f51a0cd64af4baf7e2711fbfb589 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:42.811100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:42.811615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:42.812071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:42.846170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:42.847870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:42.936590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1034/2044] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:42.948288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:42.949928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:42.987607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:42.990526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:43.018350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d7529-3d6a-43d8-a705-115c940b2fc3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:43.027311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:43.028874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:43.029705 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:43.029804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] PATH_INFO: `/v3/users/aa41b23451354c6bb2aa12973811a6f8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:43.032838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa41b23451354c6bb2aa12973811a6f8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:43.036237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:43.057976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d3dcc-b5af-412b-a480-c47750576f23 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:43.064436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:43.065566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:43.066037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:43.066507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:43.101901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:43.105875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:43.124672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1011/2045] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:43.479414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa41b23451354c6bb2aa12973811a6f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:43.660714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa41b23451354c6bb2aa12973811a6f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:43.661020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa41b23451354c6bb2aa12973811a6f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:43.672693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa41b23451354c6bb2aa12973811a6f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:43.673944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa41b23451354c6bb2aa12973811a6f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:43.702223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1035/2046] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:42 2022] DELETE /identity/v3/users/aa41b23451354c6bb2aa12973811a6f8 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:43.885220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:43.887557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:43.917322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8bcac-2c6e-4594-83ef-ed84a1297f6f service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.020701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.020701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.020701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.020701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] PATH_INFO: `/v3/projects/ef861c61382b4d03b3093b099690343d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.021521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef861c61382b4d03b3093b099690343d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.021521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.143850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.143850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:44.153777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c94c7-9568-4a2f-8387-2883778d2b97 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.159215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.160170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.160465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.160933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] PATH_INFO: `/v3/projects/381a3ddcc448429baf54ca8ac040f1a5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.163407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] RBAC: Authorizing `identity:delete_project(project_id=381a3ddcc448429baf54ca8ac040f1a5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.166112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.218270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef861c61382b4d03b3093b099690343d', 'request_id': 'req-4ec47b5f-6cee-434c-991c-e4ebe7315231'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.224466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef861c61382b4d03b3093b099690343d', 'request_id': 'req-4ec47b5f-6cee-434c-991c-e4ebe7315231'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.233650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef861c61382b4d03b3093b099690343d', 'request_id': 'req-4ec47b5f-6cee-434c-991c-e4ebe7315231'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.348274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] The token cache is being invalidate because project ef861c61382b4d03b3093b099690343d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:44.348585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.349355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4ec47b5f-6cee-434c-991c-e4ebe7315231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.353354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1012/2047] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:43 2022] DELETE /identity/v3/projects/ef861c61382b4d03b3093b099690343d => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:44.358850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88352-36be-4040-8e33-48214780a111 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.359149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88352-36be-4040-8e33-48214780a111 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.359435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd88352-36be-4040-8e33-48214780a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.365496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381a3ddcc448429baf54ca8ac040f1a5', 'request_id': 'req-73d7f664-22fe-47ae-9a5d-a9213790628e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.402517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4fd88352-36be-4040-8e33-48214780a111 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:44.404124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4fd88352-36be-4040-8e33-48214780a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:44.479870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1013/2048] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:44.483996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381a3ddcc448429baf54ca8ac040f1a5', 'request_id': 'req-73d7f664-22fe-47ae-9a5d-a9213790628e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.493836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.494338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.494793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.495993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381a3ddcc448429baf54ca8ac040f1a5', 'request_id': 'req-73d7f664-22fe-47ae-9a5d-a9213790628e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.511520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] The token cache is being invalidate because project 381a3ddcc448429baf54ca8ac040f1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:44.511808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.512485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-73d7f664-22fe-47ae-9a5d-a9213790628e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:44.514289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1036/2049] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:44 2022] DELETE /identity/v3/projects/381a3ddcc448429baf54ca8ac040f1a5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:44.518748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:44.518748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:44.520564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4de75-a3ab-43b4-ac93-091cf8b22100 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.520972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4de75-a3ab-43b4-ac93-091cf8b22100 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.521250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4de75-a3ab-43b4-ac93-091cf8b22100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.522669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:44.538403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1014/2050] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:44.540193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.547519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-caf4de75-a3ab-43b4-ac93-091cf8b22100 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:44.549594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-caf4de75-a3ab-43b4-ac93-091cf8b22100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:44.557288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e008c-efd5-4daa-966e-880b2a4c990a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.562629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1037/2051] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:44.565242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.566384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.566880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.567352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.568743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:44.569315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.574356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.576350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.576775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.577178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.593790 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1015/2052] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:18:44.598383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.600364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:44.603088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:44.612688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45568c-dd35-492a-a7c5-266f53d8771d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.617190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1038/2053] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:44.619153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.624599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.625789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.626290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.626837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.629183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.629364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7762f-8dc0-4af0-bf92-f331ffeda286 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.633040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.634278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.634980 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.635274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.635584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.636315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:44.636622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.638290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.655571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1039/2054] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:44.657441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.675883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400499f-8516-4218-98fb-f8c60997ed8d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.682369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.688551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.688551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.688551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.688551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.688551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.812442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1016/2055] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:44.816853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.823128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:44.844023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1040/2056] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:44.850175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:44.900276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa560b-d9aa-4783-bbfc-0bdf73848012 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.962048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3a9e9-5cb6-4756-b4f4-d112d5377490 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:44.967391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.968318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.968594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.968936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.969711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.972157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:44.988269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:44.989085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:44.989368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:44.989642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:44.990452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:44.992436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.090018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1041/2057] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:45.094325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.106287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43432822-4fe9-4ff2-9eab-63a304336e43 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.111321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.112007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.112288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.114681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.114681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.115103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.127685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1042/2058] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:18:45.132152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.146566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396b6fd-a25b-4fe4-8399-01b88e88fc1a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.155342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1017/2059] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:44 2022] POST /identity/v3/users => generated 289 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:18:45.156226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.156703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.157406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.157880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.158361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.159813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.162189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.168809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c0a76-6812-4b29-9200-ea0a26eeeb6e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.174180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.175452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.175908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.176361 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.177646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.181304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.181976 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1043/2060] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:18:45.186638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.198792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b485cbe-6872-4854-96fa-4693f46c41e6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.207140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1018/2061] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:45.209268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbb1da-2427-4e25-8c79-e5f67d820569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.209510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.210354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb1da-2427-4e25-8c79-e5f67d820569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.210640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb1da-2427-4e25-8c79-e5f67d820569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.210919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbb1da-2427-4e25-8c79-e5f67d820569 admin admin] PATH_INFO: `/v3/projects/658446fc889449e6bc55b5856b9ce144/users/de598ab017c64fd6b99c0ebcfa8d1b64/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.236526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420735-da88-490f-b142-669b2d63c555 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.247133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbb1da-2427-4e25-8c79-e5f67d820569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658446fc889449e6bc55b5856b9ce144, user_id=de598ab017c64fd6b99c0ebcfa8d1b64, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.251250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.251595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbb1da-2427-4e25-8c79-e5f67d820569 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.251945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.252232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.253192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.255288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.255288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.270905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1019/2062] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:45.276826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.287213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a57864-4b76-47db-829d-a3f706208e6b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.293714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ec48a-5cb9-4cc3-84a3-75e9cdf709f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.294621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ec48a-5cb9-4cc3-84a3-75e9cdf709f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.294914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ec48a-5cb9-4cc3-84a3-75e9cdf709f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.295171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ec48a-5cb9-4cc3-84a3-75e9cdf709f8 admin admin] PATH_INFO: `/v3/projects/40663a63d8dc4922879421a0c7d0c0a7/users/4b79ded3ff9146948803b1e63994a225/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.314493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ec48a-5cb9-4cc3-84a3-75e9cdf709f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40663a63d8dc4922879421a0c7d0c0a7, user_id=4b79ded3ff9146948803b1e63994a225, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.314493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ec48a-5cb9-4cc3-84a3-75e9cdf709f8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.425533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1044/2063] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:45 2022] PUT /identity/v3/projects/658446fc889449e6bc55b5856b9ce144/users/de598ab017c64fd6b99c0ebcfa8d1b64/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:45.431369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.431665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.431946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.453059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:45.454760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:45.466015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:45.509641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1020/2064] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:45 2022] PUT /identity/v3/projects/40663a63d8dc4922879421a0c7d0c0a7/users/4b79ded3ff9146948803b1e63994a225/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:45.515355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.515791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.516451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.541154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:45.542651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:45.560974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1045/2065] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:45.567394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.569694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:45.651212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1021/2066] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:45.652230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.654715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:45.669412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f524c-3937-4c06-8c9a-9bfe61e75753 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.672558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef2be7-d1f1-4a5b-ac8a-ffac6bf96241 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.675210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.676188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.676473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.676754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] PATH_INFO: `/v3/users/9fd24a9da7ca4fa8a156d59369480f8a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.679254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd24a9da7ca4fa8a156d59369480f8a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.681963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.746213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.747129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.747575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.747943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.760562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.766065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.772753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1046/2067] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:45.773728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:45.776120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:45.788953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a960-63c6-4e1a-bfd0-5831340ccbc5 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:45.793520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aae2bf-ddd9-4256-a895-38c3af63cd0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:45.794207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae2bf-ddd9-4256-a895-38c3af63cd0d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:45.794472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae2bf-ddd9-4256-a895-38c3af63cd0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:45.794743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aae2bf-ddd9-4256-a895-38c3af63cd0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:45.815874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aae2bf-ddd9-4256-a895-38c3af63cd0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:45.817632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aae2bf-ddd9-4256-a895-38c3af63cd0d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:45.829444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1047/2068] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:46.024910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd24a9da7ca4fa8a156d59369480f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:46.026709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd24a9da7ca4fa8a156d59369480f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:46.027760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd24a9da7ca4fa8a156d59369480f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:46.111057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:46.111491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd24a9da7ca4fa8a156d59369480f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:46.126350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd24a9da7ca4fa8a156d59369480f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:46.142083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1022/2069] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:45 2022] DELETE /identity/v3/users/9fd24a9da7ca4fa8a156d59369480f8a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:46.151322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:46.152301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:46.153049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:46.178442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:46.180637 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:46.272805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1048/2070] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:46.290613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:46.292335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:46.372517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:46.417127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673a399-a0ff-4f9b-9b91-6d4389b146d9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:46.429692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:46.431947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:46.432392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:46.432987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:46.456033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:46.457887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:46.471086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1023/2071] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:47.525954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:47.525954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:47.581121 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460b04-406d-46c2-b9e0-bea4c4279595 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:47.584089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:47.585026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:47.585304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:47.585741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] PATH_INFO: `/v3/projects/0b9e2cf1a4dc4dc2be51bd45d4a1c6b8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:47.588137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9e2cf1a4dc4dc2be51bd45d4a1c6b8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:47.590416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:47.773417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9e2cf1a4dc4dc2be51bd45d4a1c6b8', 'request_id': 'req-06225c72-077f-4dfc-b8c8-1403383c0d83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:47.890006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9e2cf1a4dc4dc2be51bd45d4a1c6b8', 'request_id': 'req-06225c72-077f-4dfc-b8c8-1403383c0d83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:47.903008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9e2cf1a4dc4dc2be51bd45d4a1c6b8', 'request_id': 'req-06225c72-077f-4dfc-b8c8-1403383c0d83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:47.916431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] The token cache is being invalidate because project 0b9e2cf1a4dc4dc2be51bd45d4a1c6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:47.916768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:47.917485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:47.919113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1049/2072] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:47 2022] DELETE /identity/v3/projects/0b9e2cf1a4dc4dc2be51bd45d4a1c6b8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:47.923460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:47.935864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf155a-7874-405a-a809-afe2355d4fd4 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:48.011275 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:48.012102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:48.012383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:48.012878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] PATH_INFO: `/v3/users/65b95642366c401e97b2b3f97b89701e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:48.014191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b95642366c401e97b2b3f97b89701e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:48.016308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:48.298511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b95642366c401e97b2b3f97b89701e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:48.299243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b95642366c401e97b2b3f97b89701e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:48.299863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b95642366c401e97b2b3f97b89701e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:48.523282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b95642366c401e97b2b3f97b89701e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:48.558858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b95642366c401e97b2b3f97b89701e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:48.578625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1024/2073] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:47 2022] DELETE /identity/v3/users/65b95642366c401e97b2b3f97b89701e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:49.350237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:49.353600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:49.388044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06225c72-077f-4dfc-b8c8-1403383c0d83 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:49.501203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:49.503339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:49.504539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:49.505445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] PATH_INFO: `/v3/users/6e6faad2a32645df86b9c84ff6e67b51` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:49.506678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:49.509994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:49.510631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6faad2a32645df86b9c84ff6e67b51)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:49.515759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:49.541507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92b72-abda-4190-98f2-90b59f29ffde admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:49.561745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:49.562641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:49.563059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:49.563343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] PATH_INFO: `/v3/projects/0a959a2ca3064b9ca1c5d2984f2263e8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:49.565822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a959a2ca3064b9ca1c5d2984f2263e8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:49.571932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:49.885969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a959a2ca3064b9ca1c5d2984f2263e8', 'request_id': 'req-cefd3b13-ad44-43bf-a509-eea1d9243ebc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:49.890687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6faad2a32645df86b9c84ff6e67b51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:49.910931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a959a2ca3064b9ca1c5d2984f2263e8', 'request_id': 'req-cefd3b13-ad44-43bf-a509-eea1d9243ebc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:49.925450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a959a2ca3064b9ca1c5d2984f2263e8', 'request_id': 'req-cefd3b13-ad44-43bf-a509-eea1d9243ebc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.125633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:50.128005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6faad2a32645df86b9c84ff6e67b51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.130559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6faad2a32645df86b9c84ff6e67b51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.154059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6faad2a32645df86b9c84ff6e67b51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.156891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-206d81a6-10a9-49f4-9512-1b249bf18533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6faad2a32645df86b9c84ff6e67b51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.198307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1050/2074] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:49 2022] DELETE /identity/v3/users/6e6faad2a32645df86b9c84ff6e67b51 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:50.204608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.206933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.209464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.273087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:50.273087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:50.356311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] The token cache is being invalidate because project 0a959a2ca3064b9ca1c5d2984f2263e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:50.356821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.373586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cefd3b13-ad44-43bf-a509-eea1d9243ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:50.383869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1051/2075] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:50.387157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1025/2076] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:49 2022] DELETE /identity/v3/projects/0a959a2ca3064b9ca1c5d2984f2263e8 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:50.393754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:50.396431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08d07-0670-4196-94c6-6129de2826a4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.396945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:50.401036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08d07-0670-4196-94c6-6129de2826a4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.401815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08d07-0670-4196-94c6-6129de2826a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.462464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a9e08d07-0670-4196-94c6-6129de2826a4 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:50.466516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a9e08d07-0670-4196-94c6-6129de2826a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:50.501260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1026/2077] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:50.506251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.507706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.510770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.555318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:50.558292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:50.579246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1027/2078] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:50.587561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:50.592302 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aaf89-9e3d-4fc7-aada-bc7411ab3118 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:50.600146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:50.602950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.603678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.604155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.608015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:50.612642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bb66d-19e8-4d85-b29b-835e2b00775a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:50.624652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:50.625999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.626429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.626978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.628469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:50.629249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:50.633100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:50.666640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:50.669811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1028/2079] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:50.671730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:50.672601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:50.676235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:50.696721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1052/2080] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:50.698614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:50.704345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd15e9-46f0-4f46-8a78-0d5bd4da4479 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:50.716193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:50.717903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.718389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.718874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] PATH_INFO: `/v3/users/63aaae891c8d45d994e66d584945023e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.721643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63aaae891c8d45d994e66d584945023e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:50.723274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537eaa7-ecc2-43a7-81fe-c80ecd40bccf service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:50.725756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:50.739295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:50.741662 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:50.743238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:50.743899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:50.747454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:50.752110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:50.776444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:50.922407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1053/2081] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:50 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:50.925225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:51.047196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab676f7-64d8-437a-afbc-e9042f9889ca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:51.051988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:51.052689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:51.053003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:51.053278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:51.053970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:51.057256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:51.101419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63aaae891c8d45d994e66d584945023e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:51.102971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63aaae891c8d45d994e66d584945023e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:51.104047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63aaae891c8d45d994e66d584945023e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:51.247333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1054/2082] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:50 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:51.250914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:51.269731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:51.287924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63aaae891c8d45d994e66d584945023e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:51.356282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-eeb17176-c9db-4627-976f-b690c11cb9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63aaae891c8d45d994e66d584945023e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:51.375729 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63995a-583f-445b-a0fd-aa6a30d0b067 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:51.407105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:51.409815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:51.416513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:51.419230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:51.421270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:51.433348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:51.443205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1029/2083] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:50 2022] DELETE /identity/v3/users/63aaae891c8d45d994e66d584945023e => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:51.445984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:51.446712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:51.453347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:51.469367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1055/2084] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:51.473723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:51.498644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993e8f-f97b-40c1-ba8b-eda2f0f76408 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:51.541005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:51.547419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:51.730758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:51.736268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:51.736268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:51.736268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:51.736268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:51.739110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:51.764371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1056/2085] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:51.772427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:51.776508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1030/2086] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:51.795938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed31b0-e92c-445e-8f3b-07e0c9427f47 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:51.802724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:51.806395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:51.835160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d90974-f555-49f1-b1e5-04adf564d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:51.837454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90974-f555-49f1-b1e5-04adf564d606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:51.837973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90974-f555-49f1-b1e5-04adf564d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:51.840493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d90974-f555-49f1-b1e5-04adf564d606 admin admin] PATH_INFO: `/v3/projects/626c2d56a06047499715d4ca474ee06c/users/b73b269d985b47bf977a6c00db23c664/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:51.876206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d90974-f555-49f1-b1e5-04adf564d606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626c2d56a06047499715d4ca474ee06c, user_id=b73b269d985b47bf977a6c00db23c664, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:51.882276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d90974-f555-49f1-b1e5-04adf564d606 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:51.986766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e114-32f0-479a-a2a1-9c562a880683 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:51.997153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:51.998421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:51.998877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:51.999331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:52.034334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:52.037152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:52.042076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1057/2087] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:51 2022] PUT /identity/v3/projects/626c2d56a06047499715d4ca474ee06c/users/b73b269d985b47bf977a6c00db23c664/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:52.056051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1031/2088] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:52.059092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:52.059656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:52.063365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:52.222466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] MFA Rules not processed for user `b73b269d985b47bf977a6c00db23c664`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:52.226968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:52.267021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:52.268859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:52.298784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9b7ff-be85-4ee9-b197-8bbe79c296e3 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:52.509695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1058/2089] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:52.514835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:52.560397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:52.562937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:52.563237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:52.563489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] PATH_INFO: `/v3/projects/b684c4a62ba24a9c8b1864c879faa936` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:52.568276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b684c4a62ba24a9c8b1864c879faa936)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:52.575045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:52.789840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1907-77f5-428f-b47e-798ccfcf27b6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:52.828034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b684c4a62ba24a9c8b1864c879faa936', 'request_id': 'req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:52.844308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b684c4a62ba24a9c8b1864c879faa936', 'request_id': 'req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:52.870598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b684c4a62ba24a9c8b1864c879faa936', 'request_id': 'req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.012477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] The token cache is being invalidate because project b684c4a62ba24a9c8b1864c879faa936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:53.014602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.015622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.019426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1032/2090] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:52 2022] DELETE /identity/v3/projects/b684c4a62ba24a9c8b1864c879faa936 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:53.028145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:53.030428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:53.044409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:53.047767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:53.048277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:53.048760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:53.053261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76e7f-0cd9-4807-94a3-5172f0dd0390 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:53.053536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:53.061395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:53.062992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:53.063521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:53.064001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] PATH_INFO: `/v3/users/66c0dc5f65f646fbb652d66ddda758b0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:53.065559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:53.068102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c0dc5f65f646fbb652d66ddda758b0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:53.071896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:53.365491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1059/2091] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:52 2022] POST /identity/v3/projects => generated 391 bytes in 851 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:53.373175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:53.376193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:53.387672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c0dc5f65f646fbb652d66ddda758b0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.389213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c0dc5f65f646fbb652d66ddda758b0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.390175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c0dc5f65f646fbb652d66ddda758b0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.546643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02d50-528b-4da9-a700-09b4aabf8b8a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:53.557818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:53.559284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:53.559831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:53.560373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:53.561825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:53.567805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c0dc5f65f646fbb652d66ddda758b0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.575785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:53.592729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c0dc5f65f646fbb652d66ddda758b0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:53.629036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1033/2092] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:53 2022] DELETE /identity/v3/users/66c0dc5f65f646fbb652d66ddda758b0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:53.673367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1060/2093] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:53 2022] POST /identity/v3/users => generated 302 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:53.677569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:53.683649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:53.800176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd050f-1ee2-4774-8242-50845f4f7a9c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:53.810419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:53.811336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:53.811704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:53.812040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:53.813017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:53.815026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:53.834844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:53.836863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1034/2094] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:53.853222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e799d4-d0db-4236-93b8-ed36e121ca5f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:53.867154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:53.868436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:53.873005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:53.873005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] PATH_INFO: `/v3/projects/b015e1fa03c246c6a5566c590f471f64/users/4ac34c856b7f47b2b3035ef3b7a8b0ca/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:53.926499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b015e1fa03c246c6a5566c590f471f64, user_id=4ac34c856b7f47b2b3035ef3b7a8b0ca, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:53.938041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:54.027212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:54.064462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1061/2095] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:53 2022] PUT /identity/v3/projects/b015e1fa03c246c6a5566c590f471f64/users/4ac34c856b7f47b2b3035ef3b7a8b0ca/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:54.070225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:54.100498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee50b7-658b-46e8-a5c8-5ccd9d8d38ba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:54.246488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:54.247185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:54.247572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:54.249441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:54.250274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:54.252281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:54.283288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1035/2096] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:54.286236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:54.293265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:54.295619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:54.321614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19baa3ba-3e3f-411c-8cab-8c7077c9b002 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:54.323214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064091e2-a439-45d7-8385-9b225ba494e8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:54.337294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:54.338219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:54.338500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:54.338774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] PATH_INFO: `/v3/projects/233a9a0ddff24e578698d3ae8bc92a4c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:54.342534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] RBAC: Authorizing `identity:delete_project(project_id=233a9a0ddff24e578698d3ae8bc92a4c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:54.344697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:54.353146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a7ed2-577d-4b08-8d24-ab5790ef4044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:54.353146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7ed2-577d-4b08-8d24-ab5790ef4044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:54.354070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7ed2-577d-4b08-8d24-ab5790ef4044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:54.354070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7ed2-577d-4b08-8d24-ab5790ef4044 admin admin] PATH_INFO: `/v3/projects/b015e1fa03c246c6a5566c590f471f64/users/4ac34c856b7f47b2b3035ef3b7a8b0ca/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:54.367960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a7ed2-577d-4b08-8d24-ab5790ef4044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b015e1fa03c246c6a5566c590f471f64, user_id=4ac34c856b7f47b2b3035ef3b7a8b0ca, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:54.386061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a7ed2-577d-4b08-8d24-ab5790ef4044 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:54.443155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1062/2097] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:18:54 2022] PUT /identity/v3/projects/b015e1fa03c246c6a5566c590f471f64/users/4ac34c856b7f47b2b3035ef3b7a8b0ca/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:54.455497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:54.455995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:54.456503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:54.489357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:54.524633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] MFA Rules not processed for user `4ac34c856b7f47b2b3035ef3b7a8b0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:54.526495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:54.619090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233a9a0ddff24e578698d3ae8bc92a4c', 'request_id': 'req-4961169d-3dad-43a0-9efc-e7979cc7867d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:54.641321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233a9a0ddff24e578698d3ae8bc92a4c', 'request_id': 'req-4961169d-3dad-43a0-9efc-e7979cc7867d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:54.667690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233a9a0ddff24e578698d3ae8bc92a4c', 'request_id': 'req-4961169d-3dad-43a0-9efc-e7979cc7867d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:54.734987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1063/2098] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:18:54.749345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:54.750835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:54.774730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] The token cache is being invalidate because project 233a9a0ddff24e578698d3ae8bc92a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:54.775025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:54.776219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:54.786586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1036/2099] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:54 2022] DELETE /identity/v3/projects/233a9a0ddff24e578698d3ae8bc92a4c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:54.790527 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:54.796108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:55.036852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6dbbb-374e-4d54-9c34-62043dd9b010 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:55.052635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961169d-3dad-43a0-9efc-e7979cc7867d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:55.077688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:55.078748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:55.079045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:55.083845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] PATH_INFO: `/v3/users/c3fe64e20bd7460da209e037403869cd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:55.099291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fe64e20bd7460da209e037403869cd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:55.101677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:55.188572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:55.189490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:55.189817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:55.190108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:55.198165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:55.363253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:55.364765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:55.381496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fe64e20bd7460da209e037403869cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.384500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fe64e20bd7460da209e037403869cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.388455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fe64e20bd7460da209e037403869cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.401109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1064/2100] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:18:55.450457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:55.452958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:55.512679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36521859-546e-4d24-9c5c-0aa28e4b9e80 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:55.513199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fe64e20bd7460da209e037403869cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.529623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:55.532761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fe64e20bd7460da209e037403869cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.533322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:55.533807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:55.534305 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] PATH_INFO: `/v3/projects/9394a764b4d84c0390ed84c0a0f17e0a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:55.542661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9394a764b4d84c0390ed84c0a0f17e0a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:55.547296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:55.553591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1037/2101] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:54 2022] DELETE /identity/v3/users/c3fe64e20bd7460da209e037403869cd => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:55.554688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:55.557334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:55.728320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8528b-ad51-4dde-be4d-7db2e99bdc55 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:55.734177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:55.749597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:55.749597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:55.751629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:55.757047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:55.827795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9394a764b4d84c0390ed84c0a0f17e0a', 'request_id': 'req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.897480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:55.903775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:55.921046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1038/2102] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:18:55.947492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9394a764b4d84c0390ed84c0a0f17e0a', 'request_id': 'req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:55.986681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9394a764b4d84c0390ed84c0a0f17e0a', 'request_id': 'req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:56.002690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] The token cache is being invalidate because project 9394a764b4d84c0390ed84c0a0f17e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:56.003082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:56.005661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:56.008912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1065/2103] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:55 2022] DELETE /identity/v3/projects/9394a764b4d84c0390ed84c0a0f17e0a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:56.012444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:56.014644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:56.458524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35729984-c49c-405c-a694-5456720f13ab service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:56.688264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:56.689227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:56.689507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:56.689780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] PATH_INFO: `/v3/users/fe7dd09020f64333900d8a6e2634e841` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:56.691986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7dd09020f64333900d8a6e2634e841)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:56.709684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:57.012757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7dd09020f64333900d8a6e2634e841'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.013637 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7dd09020f64333900d8a6e2634e841'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.015263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7dd09020f64333900d8a6e2634e841'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.097896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7dd09020f64333900d8a6e2634e841'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.125171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4cfd7034-2ac6-48cf-8c69-f1c875996f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7dd09020f64333900d8a6e2634e841'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.131854 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:57.147203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:57.151106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1039/2104] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:18:56 2022] DELETE /identity/v3/users/fe7dd09020f64333900d8a6e2634e841 => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:57.174028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1efc3-b100-44e0-a59d-6a7f5880f6d7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:57.307858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:57.365783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:57.370433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:57.371065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:57.371607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] PATH_INFO: `/v3/projects/7267cecf771440a0bb4c1ce4787ee310` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:57.377339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7267cecf771440a0bb4c1ce4787ee310)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:57.382904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:57.429518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:57.623028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7267cecf771440a0bb4c1ce4787ee310', 'request_id': 'req-4846054d-5a05-452c-8618-815026afb428'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.713486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7267cecf771440a0bb4c1ce4787ee310', 'request_id': 'req-4846054d-5a05-452c-8618-815026afb428'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.727948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7267cecf771440a0bb4c1ce4787ee310', 'request_id': 'req-4846054d-5a05-452c-8618-815026afb428'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.768568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] The token cache is being invalidate because project 7267cecf771440a0bb4c1ce4787ee310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:57.768967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.771142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4846054d-5a05-452c-8618-815026afb428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:57.779415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1066/2105] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:57 2022] DELETE /identity/v3/projects/7267cecf771440a0bb4c1ce4787ee310 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:18:57.782647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:57.782934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:57.783219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:57.885052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:57.885052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:58.095833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1040/2106] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:58.105877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:58.108117 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:58.109171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:58.163567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:58.166588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:58.201305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:58.202193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1067/2107] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:58.240666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d4eca-414c-4b4b-ac74-b22129fb7b06 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:58.258312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:58.263033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:58.263499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:58.264570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:58.265660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:18:58.267436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:58.275686 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:58.302175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1041/2108] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:18:58.305267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:58.318694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ba575-971f-4c99-8ef0-4d2336ce152d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:58.349294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:58.355790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:58.355790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:58.355790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:58.355790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:58.367985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:58.665159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1068/2109] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:58 2022] POST /identity/v3/projects => generated 361 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:58.672423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:58.711303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ff1-e0ef-4214-976c-654ac4b822ed admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:58.729003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:58.732692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.023922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aafe3d-b05a-43a7-8167-89cd3244c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:59.025817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aafe3d-b05a-43a7-8167-89cd3244c29f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.026119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aafe3d-b05a-43a7-8167-89cd3244c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.027401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aafe3d-b05a-43a7-8167-89cd3244c29f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.028817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aafe3d-b05a-43a7-8167-89cd3244c29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:59.036187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aafe3d-b05a-43a7-8167-89cd3244c29f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:59.055840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcf800-6ad1-42f6-82ff-d601f3e75cb5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:59.066762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:59.069764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.071200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.071678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] PATH_INFO: `/v3/projects/e5b0b09954af46088f9a25a09a62a6f6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.076094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b0b09954af46088f9a25a09a62a6f6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:59.079040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:59.200127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1042/2110] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:18:58 2022] POST /identity/v3/users => generated 281 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:59.203236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.203768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.204349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.272722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] MFA Rules not processed for user `4b79ded3ff9146948803b1e63994a225`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:59.275671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.308258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b0b09954af46088f9a25a09a62a6f6', 'request_id': 'req-6cad684e-2fcf-46d4-8575-f416738b0ffa'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:59.410634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1043/2111] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:59.411816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:59.437589 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b0b09954af46088f9a25a09a62a6f6', 'request_id': 'req-6cad684e-2fcf-46d4-8575-f416738b0ffa'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:59.454597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b0b09954af46088f9a25a09a62a6f6', 'request_id': 'req-6cad684e-2fcf-46d4-8575-f416738b0ffa'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:59.490814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] The token cache is being invalidate because project e5b0b09954af46088f9a25a09a62a6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:18:59.491257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:59.500988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:18:59.504681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1069/2112] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:18:58 2022] DELETE /identity/v3/projects/e5b0b09954af46088f9a25a09a62a6f6 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:18:59.506313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:59.510565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.590829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7ddef-55a6-4b14-bad4-f77bbdc724a4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:59.593235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d4185-4f7f-4b3c-8246-c4fb016d4aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:59.594129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d4185-4f7f-4b3c-8246-c4fb016d4aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.594360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d4185-4f7f-4b3c-8246-c4fb016d4aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.594726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d4185-4f7f-4b3c-8246-c4fb016d4aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.596121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d4185-4f7f-4b3c-8246-c4fb016d4aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:59.598157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d4185-4f7f-4b3c-8246-c4fb016d4aa1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:59.612833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1044/2113] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:59.613043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f566-c3fc-46fc-a3c1-fd14a8186721 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.613383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f566-c3fc-46fc-a3c1-fd14a8186721 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.613528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0f566-c3fc-46fc-a3c1-fd14a8186721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.651795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad684e-2fcf-46d4-8575-f416738b0ffa admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:59.672996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:59.672996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.672996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.672996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.674699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:59.674699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:59.675154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a8c0f566-c3fc-46fc-a3c1-fd14a8186721 None None] MFA Rules not processed for user `de598ab017c64fd6b99c0ebcfa8d1b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:59.675154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a8c0f566-c3fc-46fc-a3c1-fd14a8186721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.797049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1045/2114] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:59.799807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.799807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.799807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.852518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:18:59.853905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.865006 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1046/2115] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:18:59.866101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:59.868119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.894778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849c654-d9f0-4a52-84cf-2dd3db3ea9a2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:18:59.907835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc7f04-77ab-48c3-8ee9-093810ebe143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:18:59.909283 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc7f04-77ab-48c3-8ee9-093810ebe143 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.911095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc7f04-77ab-48c3-8ee9-093810ebe143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.912358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc7f04-77ab-48c3-8ee9-093810ebe143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:18:59.915055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc7f04-77ab-48c3-8ee9-093810ebe143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:18:59.920067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:18:59.923402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc7f04-77ab-48c3-8ee9-093810ebe143 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:18:59.927018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1070/2116] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:18:59 2022] POST /identity/v3/projects => generated 377 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:18:59.928296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:18:59.933984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:18:59.983803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1047/2117] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:18:59.983803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28be405-929d-4239-863d-84b096a5b326 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:18:59.983803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28be405-929d-4239-863d-84b096a5b326 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:18:59.983803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28be405-929d-4239-863d-84b096a5b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.005526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f28be405-929d-4239-863d-84b096a5b326 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:00.006044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f28be405-929d-4239-863d-84b096a5b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:00.153075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1048/2118] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:00.153075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28be405-929d-4239-863d-84b096a5b326 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.174284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc8631-18b0-430c-afdd-9ff06e8b3eca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.189975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.190621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.190910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.191189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.191365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28be405-929d-4239-863d-84b096a5b326 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.201514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.207834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.208392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.208930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.210616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.214298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.314472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.316685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.344059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1071/2119] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:00.346756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.365684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1049/2120] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:00 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:00.365684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.379079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0949c70-4bca-4d3f-b83e-4485968c34a8 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.392364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.392364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.392585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665677b-70e7-45c2-8589-ac94a549c204 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.392718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.392718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] PATH_INFO: `/v3/projects/b66d7527995446a58210747dbd23c25a/users/03bf0436c8fc43bb9e56442f7fab138e/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.398118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.399117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.399574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.399865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.400961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:00.404203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.406024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.412654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66d7527995446a58210747dbd23c25a, user_id=03bf0436c8fc43bb9e56442f7fab138e, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.417580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.434445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1050/2121] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:00.434445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.450114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435571a5-ce57-4400-9998-fb2b7b077551 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.477273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.477273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.477273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.477273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.478811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.478811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.480623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1051/2122] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:00.481636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.507263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bc975-35c4-44e3-a3a0-ceefceb86c21 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.507263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6117-e8ff-467e-94b5-f4370cc5db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.507263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6117-e8ff-467e-94b5-f4370cc5db2d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.508059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6117-e8ff-467e-94b5-f4370cc5db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.508740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6117-e8ff-467e-94b5-f4370cc5db2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.509815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6117-e8ff-467e-94b5-f4370cc5db2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.512007 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6117-e8ff-467e-94b5-f4370cc5db2d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.606987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1072/2123] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:00 2022] PUT /identity/v3/projects/b66d7527995446a58210747dbd23c25a/users/03bf0436c8fc43bb9e56442f7fab138e/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:00.607831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.681068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1052/2124] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:00.681068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.681068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.681068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.763900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] MFA Rules not processed for user `03bf0436c8fc43bb9e56442f7fab138e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:00.770347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:00.770466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ba8ad-495d-44e0-830b-1486e080c91a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:00.841472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:00.933888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:00.935091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:00.935557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:00.935994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] PATH_INFO: `/v3/projects/e15c5252b2014b189dd35e3adfa68206/users/2b018b60cc0245f3bc303cace138a050/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:00.958432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1053/2125] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:00.961319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:00.973490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15c5252b2014b189dd35e3adfa68206, user_id=2b018b60cc0245f3bc303cace138a050, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:00.977208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:00.986381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf896-d790-4f10-9b2c-1d1c82f11868 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:01.003994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:01.005920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.006578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.007092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.015905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:01.018463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:01.069927 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1073/2126] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:00 2022] PUT /identity/v3/projects/e15c5252b2014b189dd35e3adfa68206/users/2b018b60cc0245f3bc303cace138a050/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:01.076925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:01.134173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1054/2127] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:00 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:01.137657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:01.167202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58236d93-ac20-4007-8990-a8f5247d3604 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:01.205630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f983-888e-484d-8a68-7ad43facb116 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:01.212972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:01.213677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.214140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.214475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.215248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:01.218382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:01.243943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1074/2128] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:01.245819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:01.256837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b61e-98c1-4911-b3da-9cc52a1f8a5d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:01.272474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:01.275197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.276054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.276675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] PATH_INFO: `/v3/projects/e15c5252b2014b189dd35e3adfa68206/users/2b018b60cc0245f3bc303cace138a050/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.279095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15c5252b2014b189dd35e3adfa68206, user_id=2b018b60cc0245f3bc303cace138a050, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:01.282569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:01.294457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:01.295447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.295821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.296102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.297078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:01.298440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1075/2129] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:01 2022] PUT /identity/v3/projects/e15c5252b2014b189dd35e3adfa68206/users/2b018b60cc0245f3bc303cace138a050/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:01.300056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:01.314219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1055/2130] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:01.318688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:01.471694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192eca0-b279-4ed5-98bc-cb081696072a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:01.481210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafaa7-94af-462c-bdb8-25cbc546987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:01.486446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafaa7-94af-462c-bdb8-25cbc546987c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.486446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafaa7-94af-462c-bdb8-25cbc546987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.486446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafaa7-94af-462c-bdb8-25cbc546987c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.486446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafaa7-94af-462c-bdb8-25cbc546987c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:01.486446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafaa7-94af-462c-bdb8-25cbc546987c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:01.506628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1076/2131] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:01.516098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:01.544446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa5214-a0b7-45fd-9a1e-ef4e5f45c0fd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:01.573116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:01.574871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.575370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.575850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] PATH_INFO: `/v3/projects/ba051df5b27d44e896304c0437fe5141/users/87933c8cf71042ebb89d3ec42617c39c/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.619845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba051df5b27d44e896304c0437fe5141, user_id=87933c8cf71042ebb89d3ec42617c39c, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:01.632710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:01.775177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1056/2132] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:01 2022] PUT /identity/v3/projects/ba051df5b27d44e896304c0437fe5141/users/87933c8cf71042ebb89d3ec42617c39c/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:01.786965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:01.787256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:01.787541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:01.829099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] MFA Rules not processed for user `87933c8cf71042ebb89d3ec42617c39c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:01.830415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:02.047329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1077/2133] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:02.121593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:02.123905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:02.205864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:02.208144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:02.307161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a842292-b17d-4af7-9649-18df891ef33a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:02.314348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:02.315145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:02.315434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:02.315887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:02.331044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:02.339021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:02.339021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:02.350473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1057/2134] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:02.387769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d76bf-6b35-4fcf-b94b-7edde2ff0952 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:02.392924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5de537-6d07-4b1a-85b1-8bf3877743e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:02.393804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de537-6d07-4b1a-85b1-8bf3877743e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:02.394328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de537-6d07-4b1a-85b1-8bf3877743e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:02.394606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5de537-6d07-4b1a-85b1-8bf3877743e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:02.503859 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5de537-6d07-4b1a-85b1-8bf3877743e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:02.505467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5de537-6d07-4b1a-85b1-8bf3877743e9 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:02.541983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1078/2135] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:02.560638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:02.702369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc1585-fa45-4e16-9d03-c2298d27a6c2 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:02.709988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:02.711530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:02.713860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:02.714407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] PATH_INFO: `/v3/users/03bf0436c8fc43bb9e56442f7fab138e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:02.728994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03bf0436c8fc43bb9e56442f7fab138e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:02.733362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:03.051140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:03.073690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03bf0436c8fc43bb9e56442f7fab138e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:03.076838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03bf0436c8fc43bb9e56442f7fab138e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:03.079358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03bf0436c8fc43bb9e56442f7fab138e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:03.192018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03bf0436c8fc43bb9e56442f7fab138e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:03.277867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03bf0436c8fc43bb9e56442f7fab138e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:03.337447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1058/2136] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:02 2022] DELETE /identity/v3/users/03bf0436c8fc43bb9e56442f7fab138e => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:03.342985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c10c-7164-441d-b813-edda31c479ce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:03.343763 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c10c-7164-441d-b813-edda31c479ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:03.344867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c10c-7164-441d-b813-edda31c479ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:03.387010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6387c10c-7164-441d-b813-edda31c479ce None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:03.388507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6387c10c-7164-441d-b813-edda31c479ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:03.536857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1079/2137] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:03.547857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:03.551558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:03.692198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804b8d-83c9-48c5-bed0-82cca597ec86 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:03.704426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dfc2e-9321-4ece-bc7e-e1d7eeae21f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:03.705050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dfc2e-9321-4ece-bc7e-e1d7eeae21f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:03.705344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dfc2e-9321-4ece-bc7e-e1d7eeae21f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:03.705629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dfc2e-9321-4ece-bc7e-e1d7eeae21f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:03.734232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dfc2e-9321-4ece-bc7e-e1d7eeae21f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:03.738604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dfc2e-9321-4ece-bc7e-e1d7eeae21f3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:03.764194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1059/2138] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:04.667372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c10c-7164-441d-b813-edda31c479ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:04.667372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6387c10c-7164-441d-b813-edda31c479ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:04.667372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c10c-7164-441d-b813-edda31c479ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:04.667975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:04.667975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:04.667975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:04.667975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] PATH_INFO: `/v3/projects/b66d7527995446a58210747dbd23c25a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:04.668306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66d7527995446a58210747dbd23c25a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:04.668306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:04.832168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:04.855499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66d7527995446a58210747dbd23c25a', 'request_id': 'req-c5130d77-bac8-4a72-82e0-ca06dff36f19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:04.997532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66d7527995446a58210747dbd23c25a', 'request_id': 'req-c5130d77-bac8-4a72-82e0-ca06dff36f19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:05.027490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66d7527995446a58210747dbd23c25a', 'request_id': 'req-c5130d77-bac8-4a72-82e0-ca06dff36f19'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:05.045488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] The token cache is being invalidate because project b66d7527995446a58210747dbd23c25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:05.046069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:05.046996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c5130d77-bac8-4a72-82e0-ca06dff36f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:05.049511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1080/2139] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:04 2022] DELETE /identity/v3/projects/b66d7527995446a58210747dbd23c25a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:05.054365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:05.055018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:05.055786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:05.095412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:05.097349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:05.225715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1060/2140] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:05.234787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1268-5acd-4c8c-8722-f05dd3ef3f70 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:05.236076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1268-5acd-4c8c-8722-f05dd3ef3f70 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:05.236518 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1268-5acd-4c8c-8722-f05dd3ef3f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:05.261961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e71e1268-5acd-4c8c-8722-f05dd3ef3f70 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:05.264453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e71e1268-5acd-4c8c-8722-f05dd3ef3f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:05.304473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1081/2141] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:05.309551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:05.344294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc53719-4f68-4609-88c0-e6d6bf8c60bf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:05.361400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:05.362710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:05.365102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:05.367711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:05.375502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:05.379660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:05.390271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:05.434836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:05.435779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:05.436313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:05.453357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1061/2142] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:05.456281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:05.476090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] MFA Rules not processed for user `de598ab017c64fd6b99c0ebcfa8d1b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:05.481404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:05.506923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145282e1-5607-47a1-a461-f444393ff56e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:05.518019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:05.521343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:05.521997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:05.522710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:05.526084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:05.529743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:05.728879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1062/2143] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:05 2022] POST /identity/v3/projects => generated 397 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:05.733981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:05.765542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1082/2144] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:06.062174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974380a-8930-47e8-a858-1a297b834ca0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:06.081478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:06.081822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:06.082557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:06.083276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:06.085063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:06.092276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:06.252090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1063/2145] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:05 2022] POST /identity/v3/users => generated 299 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:06.257726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:06.290771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988aa69-8830-4b1b-b21a-8edd95a2d14f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:06.297286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:06.302491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:06.302491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:06.302491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:06.302491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:06.302491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:06.326329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1083/2146] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:06.332070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:06.350972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7dc49-06e2-49f9-ba40-017d136116d4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:06.368061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279157-0f08-4e62-aff6-0caef8dc64bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:06.368949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279157-0f08-4e62-aff6-0caef8dc64bc admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:06.369334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279157-0f08-4e62-aff6-0caef8dc64bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:06.369709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279157-0f08-4e62-aff6-0caef8dc64bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:06.370566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279157-0f08-4e62-aff6-0caef8dc64bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:06.372533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69279157-0f08-4e62-aff6-0caef8dc64bc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:06.395358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:06.403347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1064/2147] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:06.410619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732893-ff1d-43e0-a8a5-28c89719f9e3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:06.426170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:06.426170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:06.426170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:06.432935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] PATH_INFO: `/v3/projects/6c4fd5bc92304674a614eac26dfa43cb/users/df6085baf53146d2b81f3a1ae3a40791/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:06.494584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4fd5bc92304674a614eac26dfa43cb, user_id=df6085baf53146d2b81f3a1ae3a40791, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:06.509631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:06.641889 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1084/2148] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:06 2022] PUT /identity/v3/projects/6c4fd5bc92304674a614eac26dfa43cb/users/df6085baf53146d2b81f3a1ae3a40791/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:06.653911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:06.654415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:06.654900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:06.745788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] MFA Rules not processed for user `df6085baf53146d2b81f3a1ae3a40791`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:06.747052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:06.923402 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1065/2149] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:06.942345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:06.947599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:06.972135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:06.974018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:07.126360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38523d07-911a-4378-bd99-a434225fe8a3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:07.130475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32da3e-8e02-4bfb-9fea-5e4faa5887b5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:07.139010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:07.139935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7049-9514-4077-a68f-5d4c1924a71e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:07.141164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:07.142049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7049-9514-4077-a68f-5d4c1924a71e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:07.142506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:07.142972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7049-9514-4077-a68f-5d4c1924a71e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:07.143395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] PATH_INFO: `/v3/users/b73b269d985b47bf977a6c00db23c664` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:07.143815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7049-9514-4077-a68f-5d4c1924a71e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:07.146144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73b269d985b47bf977a6c00db23c664)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:07.150190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:07.165886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e7049-9514-4077-a68f-5d4c1924a71e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:07.167791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e7049-9514-4077-a68f-5d4c1924a71e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:07.209909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1066/2150] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:07.461468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:07.613362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73b269d985b47bf977a6c00db23c664'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:07.797365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73b269d985b47bf977a6c00db23c664'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:07.798378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73b269d985b47bf977a6c00db23c664'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:07.841237 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73b269d985b47bf977a6c00db23c664'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:07.842232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73b269d985b47bf977a6c00db23c664'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:07.972647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1085/2151] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:06 2022] DELETE /identity/v3/users/b73b269d985b47bf977a6c00db23c664 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:07.982034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:07.982463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:07.982883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:08.011464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:08.152043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:08.177091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:08.619160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1067/2152] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 636 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:08.746916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:08.749601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:08.950135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41522b9-7b13-41eb-b777-bf8eb1358036 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:08.960324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:08.962188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:08.978295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:08.978295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:09.004085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:09.006109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:09.019831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1086/2153] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:09.986909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:09.990742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:10.016351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e78cb-99eb-4d4c-ad64-c6316838736d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:10.025764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:10.027631 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:10.034464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:10.035299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] PATH_INFO: `/v3/projects/626c2d56a06047499715d4ca474ee06c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:10.044668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] RBAC: Authorizing `identity:delete_project(project_id=626c2d56a06047499715d4ca474ee06c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:10.049227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:10.085886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:10.496134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626c2d56a06047499715d4ca474ee06c', 'request_id': 'req-1269ead1-4615-4e85-a577-9b6b38d5469a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:10.510044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626c2d56a06047499715d4ca474ee06c', 'request_id': 'req-1269ead1-4615-4e85-a577-9b6b38d5469a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:10.522474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:10.545470 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626c2d56a06047499715d4ca474ee06c', 'request_id': 'req-1269ead1-4615-4e85-a577-9b6b38d5469a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:10.709269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] The token cache is being invalidate because project 626c2d56a06047499715d4ca474ee06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:10.709734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:10.711963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:10.720664 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1068/2154] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:09 2022] DELETE /identity/v3/projects/626c2d56a06047499715d4ca474ee06c => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:10.727522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:10.751324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1905d-a532-4631-917a-60d11f6388d8 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:10.923935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:10.928437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:10.928759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:10.940249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] PATH_INFO: `/v3/users/4ac34c856b7f47b2b3035ef3b7a8b0ca` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:10.945138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac34c856b7f47b2b3035ef3b7a8b0ca)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:10.950224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:11.290645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac34c856b7f47b2b3035ef3b7a8b0ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:11.455876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac34c856b7f47b2b3035ef3b7a8b0ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:11.458145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac34c856b7f47b2b3035ef3b7a8b0ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:11.476364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac34c856b7f47b2b3035ef3b7a8b0ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:11.477685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c0313238-15c4-418a-878f-44b5baf82c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac34c856b7f47b2b3035ef3b7a8b0ca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:11.517636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1087/2155] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:10 2022] DELETE /identity/v3/users/4ac34c856b7f47b2b3035ef3b7a8b0ca => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:11.999732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:12.001344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:12.026054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269ead1-4615-4e85-a577-9b6b38d5469a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:12.131681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:12.133931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:12.134571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:12.135197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] PATH_INFO: `/v3/users/b4ef6c18bad0453aaef3b652748037fc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:12.138819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ef6c18bad0453aaef3b652748037fc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:12.143226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:12.526189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ef6c18bad0453aaef3b652748037fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:12.527902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ef6c18bad0453aaef3b652748037fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:12.531300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ef6c18bad0453aaef3b652748037fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:12.673115 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ef6c18bad0453aaef3b652748037fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:12.719639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ef6c18bad0453aaef3b652748037fc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:12.749982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1069/2156] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:11 2022] DELETE /identity/v3/users/b4ef6c18bad0453aaef3b652748037fc => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:12.754432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:12.755198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:12.755198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:12.798205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:12.799583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:12.909044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1088/2157] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:12.918786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:12.920465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:12.948585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:12.950591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:12.975831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10286387-1a3b-4a29-aa6b-43aa75ce04b8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:13.008912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:13.009888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:13.010174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:13.010446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] PATH_INFO: `/v3/projects/b015e1fa03c246c6a5566c590f471f64` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:13.019457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b015e1fa03c246c6a5566c590f471f64)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:13.021486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:13.038184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f7cd0-d0c0-48c1-8ce0-739d2e01587a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:13.051272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33509da0-813e-4034-ae82-11e796ec09a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:13.052201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33509da0-813e-4034-ae82-11e796ec09a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:13.053838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33509da0-813e-4034-ae82-11e796ec09a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:13.053838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33509da0-813e-4034-ae82-11e796ec09a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:13.077427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33509da0-813e-4034-ae82-11e796ec09a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:13.080510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33509da0-813e-4034-ae82-11e796ec09a4 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:13.111919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1070/2158] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:13.307123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b015e1fa03c246c6a5566c590f471f64', 'request_id': 'req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:13.403549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:13.482728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b015e1fa03c246c6a5566c590f471f64', 'request_id': 'req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:13.495573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b015e1fa03c246c6a5566c590f471f64', 'request_id': 'req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:13.511847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] The token cache is being invalidate because project b015e1fa03c246c6a5566c590f471f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:13.512494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:13.513700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3dbe45a5-aa49-4d8a-8caf-2d32ad4430c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:13.516304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1089/2159] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:12 2022] DELETE /identity/v3/projects/b015e1fa03c246c6a5566c590f471f64 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:13.521289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:13.521536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:13.521747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:13.560611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:13.561963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:13.720457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1071/2160] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:13.728214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:13.728550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:13.728940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:13.771374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:13.772654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:13.832904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1090/2161] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:13.837095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:13.861218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb40223-97b5-403d-9334-973a66ac44e0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:13.875876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:13.876566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:13.876904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:13.877193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:13.877964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:13.878262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:13.880501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:13.895179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:13.905953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1072/2162] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:19:13.910907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:13.939149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c90a3b-c120-4564-b07d-aa5ffa90559f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:13.941901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:13.943057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:13.943557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:13.944037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:13.945873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:13.948886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:14.097049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1091/2163] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:13 2022] POST /identity/v3/projects => generated 389 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:19:14.098876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:14.112712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4509cc-1a24-42eb-996f-cbf311fab687 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:14.281993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:14.285639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:14.314823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:14.316238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.316734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.318065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.319039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:14.322857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:14.442019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1073/2164] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:14 2022] POST /identity/v3/users => generated 295 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:14.448710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:14.459158 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c47114-b609-40ed-8611-38376332eac0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:14.474626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fbc50-ae21-436f-91f0-c2d1561e75b5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:14.480049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:14.480985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.481263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.481713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] PATH_INFO: `/v3/projects/ea86547d81c84851886b16790da3fb96` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.490281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea86547d81c84851886b16790da3fb96)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:14.492923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:14.497191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:14.497903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.498182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.498460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.499229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:14.501064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:14.539142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1074/2165] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:14.542400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:14.578104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726771d-e3e0-48e1-8b73-dc661662e78e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:14.606030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:14.606770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.607082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.607355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.608130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:14.611516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:14.636385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1075/2166] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:14.640858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:14.674693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318e4b-bdf3-4f10-8b8a-8623f1e26977 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:14.681031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2df77f-47ed-4b99-886c-9d41f9389ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:14.682306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2df77f-47ed-4b99-886c-9d41f9389ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.682773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2df77f-47ed-4b99-886c-9d41f9389ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.683398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2df77f-47ed-4b99-886c-9d41f9389ac3 admin admin] PATH_INFO: `/v3/projects/db48ef2391704a73ae344f9d5be1f931/users/bfbfb6560d154fce887b76b894d91413/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.703223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2df77f-47ed-4b99-886c-9d41f9389ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db48ef2391704a73ae344f9d5be1f931, user_id=bfbfb6560d154fce887b76b894d91413, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:14.712814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2df77f-47ed-4b99-886c-9d41f9389ac3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:14.739736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea86547d81c84851886b16790da3fb96', 'request_id': 'req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:14.824072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea86547d81c84851886b16790da3fb96', 'request_id': 'req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:14.831445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea86547d81c84851886b16790da3fb96', 'request_id': 'req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:14.852814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1076/2167] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:14 2022] PUT /identity/v3/projects/db48ef2391704a73ae344f9d5be1f931/users/bfbfb6560d154fce887b76b894d91413/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:14.852814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.852814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.852814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.855002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] The token cache is being invalidate because project ea86547d81c84851886b16790da3fb96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:14.855543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:14.856436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ae94ff3-2f45-41f2-9f76-59a8560f0ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:14.859264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1092/2168] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:14 2022] DELETE /identity/v3/projects/ea86547d81c84851886b16790da3fb96 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:14.861120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c37256-b400-412e-9835-961173f9951e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:14.861678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c37256-b400-412e-9835-961173f9951e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:14.862127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c37256-b400-412e-9835-961173f9951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:14.881454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] MFA Rules not processed for user `2b018b60cc0245f3bc303cace138a050`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:14.882729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:14.902856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f7c37256-b400-412e-9835-961173f9951e None None] MFA Rules not processed for user `bfbfb6560d154fce887b76b894d91413`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:14.904880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7c37256-b400-412e-9835-961173f9951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:14.988760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:14.992340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1077/2169] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:14.997403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:14.999241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:15.047081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1093/2170] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:15.048317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c37256-b400-412e-9835-961173f9951e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:15.050348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7c37256-b400-412e-9835-961173f9951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:15.097567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a78e9b-0237-4784-beae-9fcbaefe3115 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:15.103868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:15.106039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:15.106476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:15.106901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] PATH_INFO: `/v3/users/4cb14b4dcc694e949393920f1da3eca2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:15.109417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb14b4dcc694e949393920f1da3eca2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:15.116107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:15.196815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c37256-b400-412e-9835-961173f9951e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:15.196815 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:15.197424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:15.197705 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:15.197966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:15.202276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:15.304188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:15.306273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:15.317334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1094/2171] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:15.318127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:15.320754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:15.394351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb14b4dcc694e949393920f1da3eca2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:15.395055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6951-1445-4702-bc61-63a7c5b8f790 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:15.402594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb14b4dcc694e949393920f1da3eca2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:15.407591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb14b4dcc694e949393920f1da3eca2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:15.411827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:15.417213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:15.417757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:15.419189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:15.421351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:15.425725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:15.495264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb14b4dcc694e949393920f1da3eca2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:15.514840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb14b4dcc694e949393920f1da3eca2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:15.544650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1078/2172] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:14 2022] DELETE /identity/v3/users/4cb14b4dcc694e949393920f1da3eca2 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:15.582834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1095/2173] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:15 2022] POST /identity/v3/projects => generated 389 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:15.589865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:15.591590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:15.740151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b498770-12ef-4e02-8058-862d09d31049 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:15.842704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:15.843497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:15.843672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:15.843946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:15.844751 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:15.854131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:16.136505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1079/2174] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:15 2022] POST /identity/v3/users => generated 301 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:16.140358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:16.153060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a26ea-218d-4df8-b6d9-a906cb585100 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:16.158587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:16.159291 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:16.159579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:16.159858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:16.160613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:16.162324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:16.179340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1096/2175] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:16.181368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:16.217650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e3c9-d45b-440b-9d40-323ec3574df0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:16.237646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:16.239156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:16.242810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:16.244132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] PATH_INFO: `/v3/projects/e3498ee9dcaa48ca82a697f83618aa2b/users/339828da01c74fb783a332067f1c9f48/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:16.287221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3498ee9dcaa48ca82a697f83618aa2b, user_id=339828da01c74fb783a332067f1c9f48, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:16.292292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:16.321928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:16.396897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1080/2176] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:16 2022] PUT /identity/v3/projects/e3498ee9dcaa48ca82a697f83618aa2b/users/339828da01c74fb783a332067f1c9f48/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:16.398380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:16.420335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ec498-84a1-4d61-afdd-340e9ce48511 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:16.592663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:16.593513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:16.593899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:16.594458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:16.595273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:16.597211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:16.615220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1097/2177] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:16.621362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:16.640276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbc80e-6550-46dd-a23c-76683b916a98 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:16.649669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619802dd-ddc4-4b7a-9bc1-4f55708920cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:16.651859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619802dd-ddc4-4b7a-9bc1-4f55708920cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:16.652523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619802dd-ddc4-4b7a-9bc1-4f55708920cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:16.653190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619802dd-ddc4-4b7a-9bc1-4f55708920cc admin admin] PATH_INFO: `/v3/projects/e3498ee9dcaa48ca82a697f83618aa2b/users/339828da01c74fb783a332067f1c9f48/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:16.657958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619802dd-ddc4-4b7a-9bc1-4f55708920cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3498ee9dcaa48ca82a697f83618aa2b, user_id=339828da01c74fb783a332067f1c9f48, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:16.664451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619802dd-ddc4-4b7a-9bc1-4f55708920cc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:16.694691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:16.700481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:16.711282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1081/2178] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:16 2022] PUT /identity/v3/projects/e3498ee9dcaa48ca82a697f83618aa2b/users/339828da01c74fb783a332067f1c9f48/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:16.737391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:16.738348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:16.739154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:16.749558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64dab0-93f3-4143-8d21-8dafabcbb5e2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:16.795755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:16.828714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] MFA Rules not processed for user `339828da01c74fb783a332067f1c9f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:16.834100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:16.922639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:16.926186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:16.926885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:16.927507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] PATH_INFO: `/v3/projects/10053ebd82b147e4b68dc7460aca8504` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:16.930474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10053ebd82b147e4b68dc7460aca8504)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:16.935227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:16.962464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1082/2179] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:16.983122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:16.985586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:17.147210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbfb6c-bc03-4670-8660-45177f3cd95a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:17.156960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10053ebd82b147e4b68dc7460aca8504', 'request_id': 'req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:17.243121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:17.244079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:17.244362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:17.244640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:17.340394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:17.341923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:17.357926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1083/2180] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:17.488630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10053ebd82b147e4b68dc7460aca8504', 'request_id': 'req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:17.496565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10053ebd82b147e4b68dc7460aca8504', 'request_id': 'req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:17.532620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] The token cache is being invalidate because project 10053ebd82b147e4b68dc7460aca8504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:17.532977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:17.533742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-22f1e8d0-1f0e-4c8a-b27e-5302578f7852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:17.535503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1098/2181] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:16 2022] DELETE /identity/v3/projects/10053ebd82b147e4b68dc7460aca8504 => generated 0 bytes in 845 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:17.539867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:17.541939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828b4f-ea16-492d-b31f-cf0b81dd81b5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:17.542316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828b4f-ea16-492d-b31f-cf0b81dd81b5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:17.542664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828b4f-ea16-492d-b31f-cf0b81dd81b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:17.563977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2e828b4f-ea16-492d-b31f-cf0b81dd81b5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:17.566325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2e828b4f-ea16-492d-b31f-cf0b81dd81b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:17.632657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa15ad-edb1-4cb1-9266-9c652355e922 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:17.637814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:17.638718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:17.639000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:17.639338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] PATH_INFO: `/v3/users/bfbfb6560d154fce887b76b894d91413` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:17.640576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbfb6560d154fce887b76b894d91413)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:17.643689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:17.668895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1099/2182] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:17.683670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:17.684482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:17.685284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:17.716508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:17.717783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:17.737170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1100/2183] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:17.739767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:17.748726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a58c0c-b114-4c11-84ee-482eea429d9c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:17.754898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:17.755594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:17.756290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:17.756290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:17.757442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:17.757442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:17.759122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:17.776979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1101/2184] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:17.782087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:17.796723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe31f-dd11-4168-95ce-b17a77e0813a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:17.812842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:17.814625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:17.814625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:17.814625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:17.815056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:17.817320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:18.013904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbfb6560d154fce887b76b894d91413'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:18.013904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbfb6560d154fce887b76b894d91413'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:18.013904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbfb6560d154fce887b76b894d91413'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:18.028519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1102/2185] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:17 2022] POST /identity/v3/projects => generated 387 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:18.035476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:18.044887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:18.134875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbfb6560d154fce887b76b894d91413'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:18.156701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4f039604-f3fd-46a5-915f-50059f12e302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbfb6560d154fce887b76b894d91413'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:18.174958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1084/2186] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:17 2022] DELETE /identity/v3/users/bfbfb6560d154fce887b76b894d91413 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:18.176128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56274b-238d-467b-acd5-519f4bb28c33 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:18.192053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.200540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.201455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.251329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:18.252613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:18.260895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:18.262238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.262625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.263002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.264119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:18.266364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:18.278338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1085/2187] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:18.322223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:18.323699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:18.359284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:18.447397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51117ab-088f-4471-9f8c-628b7ebb136a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:18.451986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1103/2188] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:18 2022] POST /identity/v3/users => generated 294 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:18.459385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:18.467737 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:18.471886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.472290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.472587 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.499726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9809fe-f2d1-404a-aefd-fd5d87941ed7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:18.500312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:18.503075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:18.519833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1086/2189] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:18.532170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:18.533227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.533931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.534383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.537286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:18.542284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:18.582898 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1104/2190] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:18.586927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:18.609239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1840db-6b05-4d48-b52a-221a0717239a service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:18.615757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2045-dbc0-4f89-8dd9-7b0d91574c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:18.617399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2045-dbc0-4f89-8dd9-7b0d91574c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.617644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2045-dbc0-4f89-8dd9-7b0d91574c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.617927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2045-dbc0-4f89-8dd9-7b0d91574c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.618975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d2045-dbc0-4f89-8dd9-7b0d91574c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:18.621091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d2045-dbc0-4f89-8dd9-7b0d91574c37 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:18.641307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1087/2191] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:18.642624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:18.661271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae358c-09a1-4e1c-9315-2ddcf28fc81e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:18.675064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:18.676055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.676406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.676752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] PATH_INFO: `/v3/projects/d20dc608d13e47f4af30f03ef56d707b/users/4a59527b65af449caae51e59ba10c179/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.711726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20dc608d13e47f4af30f03ef56d707b, user_id=4a59527b65af449caae51e59ba10c179, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:18.715333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:18.838287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1105/2192] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:18 2022] PUT /identity/v3/projects/d20dc608d13e47f4af30f03ef56d707b/users/4a59527b65af449caae51e59ba10c179/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:18.859863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:18.860124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:18.860613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:18.927314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] MFA Rules not processed for user `4a59527b65af449caae51e59ba10c179`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:18.928865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:19.107339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:19.114444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1088/2193] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:19.200755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:19.381439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:19.384691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:19.430733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515bce-3a82-4579-b595-ae95c4afd9f8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:19.436083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:19.436715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:19.437204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:19.437632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:19.438586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:19.455900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:19.543987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e894b-7e57-413e-ac25-7c21d408bc4f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:19.549568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:19.550484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:19.550766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:19.551043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] PATH_INFO: `/v3/users/df6085baf53146d2b81f3a1ae3a40791` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:19.552532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6085baf53146d2b81f3a1ae3a40791)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:19.555625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:19.655044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1106/2194] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:19 2022] POST /identity/v3/projects => generated 385 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:19.656318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:19.662968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:19.777476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99cd87-2878-4211-8e5a-9199934744b1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:19.791193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:19.792110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:19.792400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:19.792767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] PATH_INFO: `/v3/projects/db48ef2391704a73ae344f9d5be1f931` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:19.808073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db48ef2391704a73ae344f9d5be1f931)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:19.808073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:19.950074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6085baf53146d2b81f3a1ae3a40791'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:19.952877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6085baf53146d2b81f3a1ae3a40791'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:19.955021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6085baf53146d2b81f3a1ae3a40791'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.035793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db48ef2391704a73ae344f9d5be1f931', 'request_id': 'req-a256bef6-b7ec-4786-ba46-3df2377faa34'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.100077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6085baf53146d2b81f3a1ae3a40791'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.120565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6085baf53146d2b81f3a1ae3a40791'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.163193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1089/2195] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:19 2022] DELETE /identity/v3/users/df6085baf53146d2b81f3a1ae3a40791 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:20.163193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:20.167164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:20.169251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db48ef2391704a73ae344f9d5be1f931', 'request_id': 'req-a256bef6-b7ec-4786-ba46-3df2377faa34'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.193414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db48ef2391704a73ae344f9d5be1f931', 'request_id': 'req-a256bef6-b7ec-4786-ba46-3df2377faa34'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.233644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] The token cache is being invalidate because project db48ef2391704a73ae344f9d5be1f931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:20.239611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.240734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a256bef6-b7ec-4786-ba46-3df2377faa34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.244832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1107/2196] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:19 2022] DELETE /identity/v3/projects/db48ef2391704a73ae344f9d5be1f931 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:20.253850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:20.254500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:20.255000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:20.303135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:20.306035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:20.352030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc4be-1bb9-4f01-a329-0fd14663d800 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:20.380552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:20.383297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:20.384463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:20.384463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:20.384769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:20.386890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:20.415528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1108/2197] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:20.415528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:20.418877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:20.434297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714d787-c272-49c1-b3d4-ee44856298ad None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:20.440505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:20.441774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:20.442258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:20.442702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] PATH_INFO: `/v3/users/339828da01c74fb783a332067f1c9f48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:20.452190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] RBAC: Authorizing `identity:delete_user(user_id=339828da01c74fb783a332067f1c9f48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:20.454374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:20.591201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1090/2198] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:20 2022] POST /identity/v3/users => generated 299 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:20.592711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:20.611257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:20.730002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473d4c-4473-4335-8bf9-93fa7aa82b39 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:20.740055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:20.742192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:20.742946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:20.743424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:20.762450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:20.765788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:20.788216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1091/2199] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:20.791152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:20.793465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:20.812120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:20.826775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d1127-5432-4b47-9649-712881168d31 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:20.833337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339828da01c74fb783a332067f1c9f48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:20.850226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:20.850722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:20.851028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:20.851688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:20.854957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:20.861365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:20.890249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1092/2200] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:20.901595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:20.926714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5536-da5e-4ec1-af78-ca4885dc8e0b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:20.934438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:20.936444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:20.936970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:20.937477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] PATH_INFO: `/v3/projects/f899ab71ad4e4782a80d96185afc3aac/users/203916ffd15e4bb5a1d234edc069464c/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:20.959888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f899ab71ad4e4782a80d96185afc3aac, user_id=203916ffd15e4bb5a1d234edc069464c, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:20.963553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:21.003330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339828da01c74fb783a332067f1c9f48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.003917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339828da01c74fb783a332067f1c9f48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.014282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339828da01c74fb783a332067f1c9f48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.015598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339828da01c74fb783a332067f1c9f48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.048491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1109/2201] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:20 2022] DELETE /identity/v3/users/339828da01c74fb783a332067f1c9f48 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:21.145473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1093/2202] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:20 2022] PUT /identity/v3/projects/f899ab71ad4e4782a80d96185afc3aac/users/203916ffd15e4bb5a1d234edc069464c/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:21.150368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:21.152278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:21.197639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:21.199582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:21.232771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2b8f3-ecb4-4193-808f-b6b8b63a581c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:21.360744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1a9b4-dda2-449a-acb3-8bc729100ddb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:21.368132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:21.369331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:21.369619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:21.369904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] PATH_INFO: `/v3/users/87933c8cf71042ebb89d3ec42617c39c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:21.371763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87933c8cf71042ebb89d3ec42617c39c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:21.374148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:21.375864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:21.377439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:21.379472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:21.379969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:21.381547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:21.387037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:21.412582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1110/2203] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:21.414403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:21.426704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1a46-f869-49f4-9dd8-5aaa85a6b3b0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:21.432895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27325712-002f-4045-a883-a09f22117016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:21.434366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27325712-002f-4045-a883-a09f22117016 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:21.434630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27325712-002f-4045-a883-a09f22117016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:21.434916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27325712-002f-4045-a883-a09f22117016 admin admin] PATH_INFO: `/v3/projects/f899ab71ad4e4782a80d96185afc3aac/users/203916ffd15e4bb5a1d234edc069464c/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:21.437082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27325712-002f-4045-a883-a09f22117016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f899ab71ad4e4782a80d96185afc3aac, user_id=203916ffd15e4bb5a1d234edc069464c, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:21.439772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27325712-002f-4045-a883-a09f22117016 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:21.462336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1111/2204] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:21 2022] PUT /identity/v3/projects/f899ab71ad4e4782a80d96185afc3aac/users/203916ffd15e4bb5a1d234edc069464c/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:21.475012 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:21.475444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:21.475726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:21.510562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] MFA Rules not processed for user `203916ffd15e4bb5a1d234edc069464c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:21.511840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:21.617569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1112/2205] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:21.636419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:21.641241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:21.646900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87933c8cf71042ebb89d3ec42617c39c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.650395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87933c8cf71042ebb89d3ec42617c39c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.651747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87933c8cf71042ebb89d3ec42617c39c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.787949 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87933c8cf71042ebb89d3ec42617c39c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.816749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f3623-0185-4c89-a6fa-fe32b3b5fc07 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:21.828614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:21.830882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:21.830882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:21.831091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] PATH_INFO: `/v3/projects/6c4fd5bc92304674a614eac26dfa43cb` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:21.836282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4fd5bc92304674a614eac26dfa43cb)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:21.836657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:21.850145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87933c8cf71042ebb89d3ec42617c39c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:21.880533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1094/2206] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:21 2022] DELETE /identity/v3/users/87933c8cf71042ebb89d3ec42617c39c => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:21.880533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:21.883917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:22.018268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26383efc-1f49-4862-8962-4ff0cfb9bb96 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:22.024912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:22.026396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:22.026617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:22.027025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:22.030543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:22.082549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4fd5bc92304674a614eac26dfa43cb', 'request_id': 'req-6a8a535d-a370-43fc-abc5-15c3ce472592'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.151674 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:22.153268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccb80c-3964-4e93-88b7-34d34f20bed3 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:22.166146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1095/2207] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:22.167655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:22.168106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:22.168475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:22.198880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:22.201135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:22.237581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4fd5bc92304674a614eac26dfa43cb', 'request_id': 'req-6a8a535d-a370-43fc-abc5-15c3ce472592'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.260349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4fd5bc92304674a614eac26dfa43cb', 'request_id': 'req-6a8a535d-a370-43fc-abc5-15c3ce472592'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.279829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] The token cache is being invalidate because project 6c4fd5bc92304674a614eac26dfa43cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:22.280359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.281799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.284767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1113/2208] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:21 2022] DELETE /identity/v3/projects/6c4fd5bc92304674a614eac26dfa43cb => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:22.286265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:22.295078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:22.334327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1096/2209] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:22.334327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:22.343992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:22.361570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88113b-779f-426e-b50a-7b92394576f8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:22.369649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:22.370602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:22.370899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:22.371140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] PATH_INFO: `/v3/users/4a59527b65af449caae51e59ba10c179` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:22.372588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a59527b65af449caae51e59ba10c179)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:22.374678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:22.433615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a535d-a370-43fc-abc5-15c3ce472592 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:22.444367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:22.447360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:22.447880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:22.448380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] PATH_INFO: `/v3/projects/e3498ee9dcaa48ca82a697f83618aa2b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:22.450877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3498ee9dcaa48ca82a697f83618aa2b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:22.454713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:22.768248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3498ee9dcaa48ca82a697f83618aa2b', 'request_id': 'req-be3386bf-a7f8-481a-8b1d-49cc9aa87125'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.774732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a59527b65af449caae51e59ba10c179'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.776053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a59527b65af449caae51e59ba10c179'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.777651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a59527b65af449caae51e59ba10c179'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.877639 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3498ee9dcaa48ca82a697f83618aa2b', 'request_id': 'req-be3386bf-a7f8-481a-8b1d-49cc9aa87125'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.894178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3498ee9dcaa48ca82a697f83618aa2b', 'request_id': 'req-be3386bf-a7f8-481a-8b1d-49cc9aa87125'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.926543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] The token cache is being invalidate because project e3498ee9dcaa48ca82a697f83618aa2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:22.927065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.930449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:22.931142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1114/2210] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:22 2022] DELETE /identity/v3/projects/e3498ee9dcaa48ca82a697f83618aa2b => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:22.932285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:22.934813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:23.003148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a59527b65af449caae51e59ba10c179'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:23.026613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c2afd842-aa33-46f4-bb53-ec6177aa698e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a59527b65af449caae51e59ba10c179'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:23.037352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3386bf-a7f8-481a-8b1d-49cc9aa87125 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:23.045563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:23.046717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.047252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.047697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.050862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:23.061209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1097/2211] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:22 2022] DELETE /identity/v3/users/4a59527b65af449caae51e59ba10c179 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:23.063432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9ee6-cec4-4e19-b5a6-b24d9bcb8b6f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.063980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9ee6-cec4-4e19-b5a6-b24d9bcb8b6f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.064465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d9ee6-cec4-4e19-b5a6-b24d9bcb8b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.094219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c36d9ee6-cec4-4e19-b5a6-b24d9bcb8b6f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:23.096497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c36d9ee6-cec4-4e19-b5a6-b24d9bcb8b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:23.188774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:23.199839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:23.199839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9c97e-eef6-43d4-bece-fb973b9103fb service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:23.210942 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1115/2212] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:23.219814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.219814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.219814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.235586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:23.237471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:23.238307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1098/2213] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:23.249097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.249386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.249661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.254289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1116/2214] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:23.270143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:23.274141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:23.275364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:23.296683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1099/2215] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:23.297673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:23.316432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540b58-483f-48fb-bd22-25de13a6e933 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:23.326511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:23.326838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.327325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.327854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.328825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:23.329327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:23.331452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:23.352839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1100/2216] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:23.356167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:23.367039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f07e6-2323-45c1-8fcc-bab698779c4b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:23.384041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:23.384041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.384041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.384041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.384487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3511-8618-4165-8ea5-0f5ed70828df admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:23.395948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:23.397318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.397641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.398310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.399051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:23.401309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:23.419215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:23.441174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:23.454549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1117/2217] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:23.597026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1101/2218] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:23 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:23.597997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:23.610669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395813f3-2247-4f9c-8edf-6a1765d1e8f2 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:23.695554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:23.696344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.696702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.697075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.697999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:23.700118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:23.943346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1118/2219] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:23 2022] POST /identity/v3/users => generated 291 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:23.944591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:23.957046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6488b-2341-428c-ba13-5e90c4ff7826 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:23.963725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:23.975325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:23.975325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:23.975325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:23.975325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:23.975325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:23.991975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1102/2220] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:23.996844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:24.021380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bf745-12bc-486f-b436-48ff4b7feef9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:24.023460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:24.027822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:24.028046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:24.028930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.029235 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.033755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.035248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:24.037218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:24.059093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1119/2221] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:24.066114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:24.092937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7699daa-9a60-476d-a53d-dfa8c6f58421 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:24.097451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:24.099479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.099808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.100119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] PATH_INFO: `/v3/projects/f74ab4037d72442ab2b4c22c6cdf098d/users/aded3e3317c542b093d8f25beb5d2c1e/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.122843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74ab4037d72442ab2b4c22c6cdf098d, user_id=aded3e3317c542b093d8f25beb5d2c1e, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:24.126168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:24.127005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc192-6a71-4445-a18b-290f181e223f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:24.137150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:24.138281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.138572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.139027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] PATH_INFO: `/v3/projects/ba051df5b27d44e896304c0437fe5141` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.141023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba051df5b27d44e896304c0437fe5141)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:24.143515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:24.360998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1120/2222] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:24 2022] PUT /identity/v3/projects/f74ab4037d72442ab2b4c22c6cdf098d/users/aded3e3317c542b093d8f25beb5d2c1e/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:24.362084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:24.363880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:24.379832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba051df5b27d44e896304c0437fe5141', 'request_id': 'req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.393579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba051df5b27d44e896304c0437fe5141', 'request_id': 'req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.405354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba051df5b27d44e896304c0437fe5141', 'request_id': 'req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.419782 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:24.472650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6499-6309-410b-bab4-27bad2276cb4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:24.504370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] The token cache is being invalidate because project ba051df5b27d44e896304c0437fe5141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:24.505302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.506403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a2b7a5d-76f7-4bf2-a986-df3ae783923d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.511182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1103/2223] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:24 2022] DELETE /identity/v3/projects/ba051df5b27d44e896304c0437fe5141 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:24.514076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d234c-e2af-4cf6-ac0a-9bbc2fa4fdcd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.514853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d234c-e2af-4cf6-ac0a-9bbc2fa4fdcd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.515529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d234c-e2af-4cf6-ac0a-9bbc2fa4fdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.568532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:24.570091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.571020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.571562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] PATH_INFO: `/v3/projects/d20dc608d13e47f4af30f03ef56d707b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.574032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20dc608d13e47f4af30f03ef56d707b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:24.575923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-090d234c-e2af-4cf6-ac0a-9bbc2fa4fdcd None None] MFA Rules not processed for user `aded3e3317c542b093d8f25beb5d2c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:24.577744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:24.579485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-090d234c-e2af-4cf6-ac0a-9bbc2fa4fdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:24.682004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1104/2224] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:24.683317 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.683613 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.683889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.705148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:24.706499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:24.728872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1105/2225] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:24.730313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:24.733540 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:24.766786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20dc608d13e47f4af30f03ef56d707b', 'request_id': 'req-e361118a-c629-414f-9802-ffa91d944b40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.770927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acf96e-b8e7-40be-98c4-49004e8f6c0b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:24.861132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20dc608d13e47f4af30f03ef56d707b', 'request_id': 'req-e361118a-c629-414f-9802-ffa91d944b40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.874314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20dc608d13e47f4af30f03ef56d707b', 'request_id': 'req-e361118a-c629-414f-9802-ffa91d944b40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.891782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:24.892618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.893143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.893395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.894237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:24.896386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:24.903671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] The token cache is being invalidate because project d20dc608d13e47f4af30f03ef56d707b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:24.904286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.905607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e361118a-c629-414f-9802-ffa91d944b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:24.908864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1121/2226] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:24 2022] DELETE /identity/v3/projects/d20dc608d13e47f4af30f03ef56d707b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:24.911399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:24.912679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:24.912679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:24.956400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:24.958691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:24.973593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1122/2227] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:24.974910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:24.977136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:25.004052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc190f-cf19-4503-828b-aae63420496b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.013895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.015605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.016102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.016602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] PATH_INFO: `/v3/users/203916ffd15e4bb5a1d234edc069464c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.018931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=203916ffd15e4bb5a1d234edc069464c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.022799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.073072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1106/2228] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:24 2022] POST /identity/v3/projects => generated 379 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:25.074126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.194330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d056a-bfe2-4691-93fc-2f621fc40a1a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.206320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.207194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.207688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.208175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.209138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:25.209502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.212475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.238152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1107/2229] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:25.238152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.245127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:25.267974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7b951-2964-4075-9523-16fc938322dc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.277151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.277908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.278252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.278583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.279863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.283649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.368046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203916ffd15e4bb5a1d234edc069464c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:25.490149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1108/2230] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:25 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:25.491052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.502281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93ad59-99d8-44aa-966a-f135d08ffaa9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.507004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.508735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.509058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.509336 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.509987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203916ffd15e4bb5a1d234edc069464c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:25.510526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.510655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203916ffd15e4bb5a1d234edc069464c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:25.511925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.518771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203916ffd15e4bb5a1d234edc069464c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:25.519499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203916ffd15e4bb5a1d234edc069464c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:25.542220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1123/2231] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:24 2022] DELETE /identity/v3/users/203916ffd15e4bb5a1d234edc069464c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:25.543212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.548710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:25.619070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f75c06-9fcd-46a2-9536-7fd954ad8d32 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.628812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.629832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.630289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.630801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.632931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.636362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.641431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1109/2232] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:25 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:25.645670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.648024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:25.659562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1124/2233] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:25.661412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.677388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f747088-2709-4536-a715-b68c6e717bf2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.735669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164cb45-a8f9-4af4-a041-869fb9f14fcc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.739787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.740506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.740660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.740985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.741218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.741880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] PATH_INFO: `/v3/projects/b74f75c7975445729af87e8dcbf6e564/users/1b426017e34c4f5a986d935e5a8101f1/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.742248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.742388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.743047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.745855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.768218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74f75c7975445729af87e8dcbf6e564, user_id=1b426017e34c4f5a986d935e5a8101f1, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.772070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.882751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1125/2234] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:25 2022] PUT /identity/v3/projects/b74f75c7975445729af87e8dcbf6e564/users/1b426017e34c4f5a986d935e5a8101f1/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:25.885134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1110/2235] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:25 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:19:25.889077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.889345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:25.903154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea9b0e-af90-4193-a675-fcad65e6c5f0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:25.990143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:25.991063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:25.992211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:25.992616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:25.993576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:25.996082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:25.997572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5450b4-d46e-478e-bb01-1af5af9f6454 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.004680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.005544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.005836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.006116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.007046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.012839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.021867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1111/2236] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:26.026993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:26.032398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1126/2237] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:26.036488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:26.039979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e115a2-fe42-4db6-8cc9-9dbc684be5f5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.048546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcecd1-6e15-4f8b-9901-e25fdaa61fc8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.049904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.050996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.051273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.051544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] PATH_INFO: `/v3/projects/b74f75c7975445729af87e8dcbf6e564/users/1b426017e34c4f5a986d935e5a8101f1/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.053685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74f75c7975445729af87e8dcbf6e564, user_id=1b426017e34c4f5a986d935e5a8101f1, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.056178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1069-55dd-49bf-ba86-b779fa26d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.056964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1069-55dd-49bf-ba86-b779fa26d281 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.057247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1069-55dd-49bf-ba86-b779fa26d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.057511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.057614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1069-55dd-49bf-ba86-b779fa26d281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.058239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1069-55dd-49bf-ba86-b779fa26d281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.059847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1069-55dd-49bf-ba86-b779fa26d281 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.073768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1112/2238] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:26 2022] PUT /identity/v3/projects/b74f75c7975445729af87e8dcbf6e564/users/1b426017e34c4f5a986d935e5a8101f1/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:26.083397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1127/2239] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:26.085240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:26.088025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.088383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.088721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.137714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] MFA Rules not processed for user `1b426017e34c4f5a986d935e5a8101f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:26.139786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:26.204910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7515c-b9db-4a61-83ca-5058a1d750b7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.210869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5621ae-d674-41c9-8215-f0f981198272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.212929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5621ae-d674-41c9-8215-f0f981198272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.212929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5621ae-d674-41c9-8215-f0f981198272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.212929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5621ae-d674-41c9-8215-f0f981198272 admin admin] PATH_INFO: `/v3/projects/bb4c33274e584df8a977aaf5c4add4be/users/f0dbcf81c947482d9d1012f7b6a92427/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.240249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5621ae-d674-41c9-8215-f0f981198272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4c33274e584df8a977aaf5c4add4be, user_id=f0dbcf81c947482d9d1012f7b6a92427, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.251065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5621ae-d674-41c9-8215-f0f981198272 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.268281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1128/2240] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:26.281982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:26.283604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:26.416208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa898d1-1b45-4874-a368-52886cfbece2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.430886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.432171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.432617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.433104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.444659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.446467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.458462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1129/2241] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:26.459758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:26.462228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:26.465332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1113/2242] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:26 2022] PUT /identity/v3/projects/bb4c33274e584df8a977aaf5c4add4be/users/f0dbcf81c947482d9d1012f7b6a92427/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:26.469952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad474-25ef-4055-922a-bc8779157799 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.475485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad474-25ef-4055-922a-bc8779157799 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.475485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad474-25ef-4055-922a-bc8779157799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.493320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd598-d034-4258-87b4-3cf8e4462ac0 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.498534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-109ad474-25ef-4055-922a-bc8779157799 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:26.500281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-109ad474-25ef-4055-922a-bc8779157799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:26.584604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1114/2243] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:26.597233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad474-25ef-4055-922a-bc8779157799 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:26.599174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-109ad474-25ef-4055-922a-bc8779157799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:26.601359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.602636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.603380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.603877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] PATH_INFO: `/v3/projects/f899ab71ad4e4782a80d96185afc3aac` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.605792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f899ab71ad4e4782a80d96185afc3aac)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.607952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.710091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad474-25ef-4055-922a-bc8779157799 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:26.763967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68d6c3-6daa-47ec-85aa-6fb96fd07948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:26.768512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68d6c3-6daa-47ec-85aa-6fb96fd07948 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.769329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68d6c3-6daa-47ec-85aa-6fb96fd07948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.775187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68d6c3-6daa-47ec-85aa-6fb96fd07948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.794182 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f899ab71ad4e4782a80d96185afc3aac', 'request_id': 'req-a0a55990-512b-4583-896a-bcc15658ffd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:26.810996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68d6c3-6daa-47ec-85aa-6fb96fd07948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:26.813904 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68d6c3-6daa-47ec-85aa-6fb96fd07948 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:26.841293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1115/2244] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:26.900565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f899ab71ad4e4782a80d96185afc3aac', 'request_id': 'req-a0a55990-512b-4583-896a-bcc15658ffd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:26.903724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:26.908652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f899ab71ad4e4782a80d96185afc3aac', 'request_id': 'req-a0a55990-512b-4583-896a-bcc15658ffd5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:26.924686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] The token cache is being invalidate because project f899ab71ad4e4782a80d96185afc3aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:26.925312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:26.925856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a0a55990-512b-4583-896a-bcc15658ffd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:26.927661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1130/2245] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:26 2022] DELETE /identity/v3/projects/f899ab71ad4e4782a80d96185afc3aac => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:26.938067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:26.939042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:26.939210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:26.968846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:26.970111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:27.065496 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1116/2246] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:27.086862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.092475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.092475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.126398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:27.129018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:27.160837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.170646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1131/2247] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:27.176632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a133ab1-f1d2-458a-bc53-c8d4b658e216 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.185522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.186326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.186753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.187128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.187975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:27.188378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.190551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:27.210580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1117/2248] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:27.221922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.247760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473bd8e-038e-4772-8404-affc43542db0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.270904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.276120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.276120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.276120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.277473 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.279434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:27.536681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1132/2249] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:27 2022] POST /identity/v3/projects => generated 387 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:19:27.542777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.559193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e7c46-6f0b-41df-9ed0-f1aab5d0131a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.595865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.598686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:27.680758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.681803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.682165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.682560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.683344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.686167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:27.766880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:27.771445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4ba9-7656-4a5c-8858-4af85a27bb72 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.778517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.779131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.779472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.779828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] PATH_INFO: `/v3/users/aded3e3317c542b093d8f25beb5d2c1e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.781269 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aded3e3317c542b093d8f25beb5d2c1e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.783338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:27.813703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1118/2250] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:27 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:19:27.821451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.846207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270f64d-7ab5-4d5f-8dea-ffe61cfa36d2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.855920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.857171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.857860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.858150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.859138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.861640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:27.876011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1119/2251] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:27.881069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.895063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d15d3-d8d4-4652-8fb3-7be000225850 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.901307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.902230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.902517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.902802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.903567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.905403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:27.918569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1120/2252] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:27.924398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:27.937472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cc20c-0efa-422d-9d40-5ef9cee924a6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:27.943488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbac9e-1e55-4a33-aba8-dcad3ce4f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:27.945598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbac9e-1e55-4a33-aba8-dcad3ce4f5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:27.947291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbac9e-1e55-4a33-aba8-dcad3ce4f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:27.947767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbac9e-1e55-4a33-aba8-dcad3ce4f5a8 admin admin] PATH_INFO: `/v3/projects/a16cdec42c774999ab305bf7173fdcb0/users/79ec9263f3a844f69584c50054804f42/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:27.975770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbac9e-1e55-4a33-aba8-dcad3ce4f5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16cdec42c774999ab305bf7173fdcb0, user_id=79ec9263f3a844f69584c50054804f42, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:27.979925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbac9e-1e55-4a33-aba8-dcad3ce4f5a8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:28.058769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aded3e3317c542b093d8f25beb5d2c1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:28.082455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1121/2253] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:27 2022] PUT /identity/v3/projects/a16cdec42c774999ab305bf7173fdcb0/users/79ec9263f3a844f69584c50054804f42/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:28.094383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:28.094873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:28.095150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:28.132569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] MFA Rules not processed for user `79ec9263f3a844f69584c50054804f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:28.134296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:28.190141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aded3e3317c542b093d8f25beb5d2c1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:28.192969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aded3e3317c542b093d8f25beb5d2c1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:28.208487 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aded3e3317c542b093d8f25beb5d2c1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:28.211027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a039146-3c62-49df-8605-ccede727cd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aded3e3317c542b093d8f25beb5d2c1e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:28.256643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1133/2254] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:27 2022] DELETE /identity/v3/users/aded3e3317c542b093d8f25beb5d2c1e => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:28.259393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:28.259683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:28.259960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:28.289330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:28.290877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:28.343041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1122/2255] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:28.348159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:28.351786 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:28.405772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1134/2256] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:28.448599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:28.451377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:28.541517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c252-eeb2-4a4d-9a86-51827a7c75c8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:28.551728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:28.553372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:28.554871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:28.555691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:28.557341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:28.562375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:28.587541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e37ad-7043-458f-a7b9-3290a5cfcd72 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:28.591890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:28.592768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:28.593173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:28.593452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:28.631644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:28.633251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:28.645532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1135/2257] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:28.702997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1123/2258] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:28 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:28.708095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:28.720186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62917d4f-6c56-47ec-87d3-020ae4010499 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:28.860481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:28.861201 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:28.861491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:28.861799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:28.862628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:28.864922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.028500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1136/2259] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:28 2022] POST /identity/v3/users => generated 299 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:29.050222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.063480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64db0c-9d0f-4060-bd94-b281ec1256e3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.069209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.070190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.070756 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.071267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.072126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:29.074040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.092530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1124/2260] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:29.094981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.115341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba5564-4d2c-4129-ac19-844414fa8b4d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.121808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e722e1-eeda-49af-aa0f-22e1353c765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.122774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e722e1-eeda-49af-aa0f-22e1353c765e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.123124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e722e1-eeda-49af-aa0f-22e1353c765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.123431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e722e1-eeda-49af-aa0f-22e1353c765e admin admin] PATH_INFO: `/v3/projects/38a16b974ad7456db9723f64e71bf950/users/24dd40255cf0418fb59735127b1739bd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.143346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e722e1-eeda-49af-aa0f-22e1353c765e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a16b974ad7456db9723f64e71bf950, user_id=24dd40255cf0418fb59735127b1739bd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:29.146272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e722e1-eeda-49af-aa0f-22e1353c765e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.219460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:29.341198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1137/2261] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:29 2022] PUT /identity/v3/projects/38a16b974ad7456db9723f64e71bf950/users/24dd40255cf0418fb59735127b1739bd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:29.348549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.359861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae79c84-006f-48b6-bc4e-ff5152d4bf70 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.405394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.405755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.406044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.479815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.481221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.481720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.492725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.492725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:29.492725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.495205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] MFA Rules not processed for user `f0dbcf81c947482d9d1012f7b6a92427`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:29.496628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.504041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1125/2262] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:29.505761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.509958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.532427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1729-2e72-4d55-9345-bb4127bce1a4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.539816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.541173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.541609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.542033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] PATH_INFO: `/v3/projects/f74ab4037d72442ab2b4c22c6cdf098d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.543553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74ab4037d72442ab2b4c22c6cdf098d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:29.545823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.594597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1138/2263] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:29.599157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.613061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e455-65aa-45b1-b6d1-22ded21f683b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.619633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.620593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.620907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.621190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] PATH_INFO: `/v3/projects/38a16b974ad7456db9723f64e71bf950/users/24dd40255cf0418fb59735127b1739bd/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.623497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a16b974ad7456db9723f64e71bf950, user_id=24dd40255cf0418fb59735127b1739bd, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:29.626345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.646453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1139/2264] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:29 2022] PUT /identity/v3/projects/38a16b974ad7456db9723f64e71bf950/users/24dd40255cf0418fb59735127b1739bd/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:29.647446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.649540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.683025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74ab4037d72442ab2b4c22c6cdf098d', 'request_id': 'req-60928b67-d26e-456f-a913-478cccc7f585'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:29.689342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74ab4037d72442ab2b4c22c6cdf098d', 'request_id': 'req-60928b67-d26e-456f-a913-478cccc7f585'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:29.700319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74ab4037d72442ab2b4c22c6cdf098d', 'request_id': 'req-60928b67-d26e-456f-a913-478cccc7f585'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:29.735124 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60192051-2ef9-4e70-b3a9-1a2b8c703929 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.780174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] The token cache is being invalidate because project f74ab4037d72442ab2b4c22c6cdf098d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:29.780608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:29.781397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-60928b67-d26e-456f-a913-478cccc7f585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:29.783065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1126/2265] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:29 2022] DELETE /identity/v3/projects/f74ab4037d72442ab2b4c22c6cdf098d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:29.784353 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.784638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.784955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.795624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.796284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.796564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.797084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:29.799044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.814698 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] MFA Rules not processed for user `24dd40255cf0418fb59735127b1739bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:29.816054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.879811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:29.880432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:29.895548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1140/2266] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:29.897395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.899494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.912192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1127/2267] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:29.935496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:29.937166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:29.938826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:29.959084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb31ae-e810-42e8-a72e-114b8127dbcf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:29.974409 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:29.976593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:29.977373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:29.978520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:30.008122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:30.011152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:30.021896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710184-e225-4532-90d3-ab54c69cc215 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:30.031948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:30.032403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1128/2268] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:30.034116 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:30.034552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:30.034996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] PATH_INFO: `/v3/users/1b426017e34c4f5a986d935e5a8101f1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:30.037004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b426017e34c4f5a986d935e5a8101f1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:30.043904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:30.186265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:30.188423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:30.229340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b0fae-6e29-4d66-b057-6e9cebdce496 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:30.240149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:30.241431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:30.241431 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:30.241695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] PATH_INFO: `/v3/users/79ec9263f3a844f69584c50054804f42` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:30.243190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ec9263f3a844f69584c50054804f42)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:30.245340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:30.540178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ec9263f3a844f69584c50054804f42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:30.543174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ec9263f3a844f69584c50054804f42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:30.549341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ec9263f3a844f69584c50054804f42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:30.550756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b426017e34c4f5a986d935e5a8101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:30.729583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ec9263f3a844f69584c50054804f42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:30.754146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5b2ad54c-e02f-4af6-b182-56bde3fbef7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ec9263f3a844f69584c50054804f42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:30.769768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1129/2269] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:30 2022] DELETE /identity/v3/users/79ec9263f3a844f69584c50054804f42 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:30.775269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:30.775611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:30.776261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:30.801636 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:30.803371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:30.885069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1130/2270] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:30.897129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:30.904865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:30.971170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4afdc-44c3-42d1-8e9a-5f9baabe1e84 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:30.975339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bbf77-8d64-40cf-b740-83aff56fa859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:30.976866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bbf77-8d64-40cf-b740-83aff56fa859 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:30.977237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bbf77-8d64-40cf-b740-83aff56fa859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:30.977462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bbf77-8d64-40cf-b740-83aff56fa859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:30.987836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bbf77-8d64-40cf-b740-83aff56fa859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:30.989492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29bbf77-8d64-40cf-b740-83aff56fa859 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:31.001839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1131/2271] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:31.106084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b426017e34c4f5a986d935e5a8101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:31.115749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b426017e34c4f5a986d935e5a8101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:31.127159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b426017e34c4f5a986d935e5a8101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:31.127949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b426017e34c4f5a986d935e5a8101f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:31.161054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1141/2272] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:29 2022] DELETE /identity/v3/users/1b426017e34c4f5a986d935e5a8101f1 => generated 0 bytes in 1264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:31.831189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:31.832378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:31.832670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:31.874018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:31.875593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:31.938494 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1132/2273] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:19:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:31.996888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:31.997983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:31.999825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:32.002162 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:32.091991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cba1c-e6db-4d20-b2bc-3e257c5b8582 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:32.098025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:32.101686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.101686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.101686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] PATH_INFO: `/v3/projects/a16cdec42c774999ab305bf7173fdcb0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.102061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16cdec42c774999ab305bf7173fdcb0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:32.107846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:32.120602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eb373-4cf2-419c-ab28-5fe55a317bb7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:32.127681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:32.128342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.128627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.128966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.145238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:32.147558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:32.160991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1133/2274] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:19:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:19:32.162708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:32.165222 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:32.181583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6abdc-5e36-4722-ab3a-f8d1d2b546ec service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:32.188414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:32.189345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.193570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.193570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] PATH_INFO: `/v3/projects/b74f75c7975445729af87e8dcbf6e564` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.193570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74f75c7975445729af87e8dcbf6e564)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:32.193570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:32.343168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16cdec42c774999ab305bf7173fdcb0', 'request_id': 'req-fc960fef-966e-4401-9c3b-96488bed5470'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.424687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16cdec42c774999ab305bf7173fdcb0', 'request_id': 'req-fc960fef-966e-4401-9c3b-96488bed5470'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.426282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:32.443612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74f75c7975445729af87e8dcbf6e564', 'request_id': 'req-fc200679-fc50-4353-8508-58728478b0e4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.448387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16cdec42c774999ab305bf7173fdcb0', 'request_id': 'req-fc960fef-966e-4401-9c3b-96488bed5470'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.466984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] The token cache is being invalidate because project a16cdec42c774999ab305bf7173fdcb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:32.468290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.468689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.470163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74f75c7975445729af87e8dcbf6e564', 'request_id': 'req-fc200679-fc50-4353-8508-58728478b0e4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.472042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1142/2275] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:31 2022] DELETE /identity/v3/projects/a16cdec42c774999ab305bf7173fdcb0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:32.476944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:32.479051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:32.483848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74f75c7975445729af87e8dcbf6e564', 'request_id': 'req-fc200679-fc50-4353-8508-58728478b0e4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.608071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] The token cache is being invalidate because project b74f75c7975445729af87e8dcbf6e564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:32.617582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.632256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc960fef-966e-4401-9c3b-96488bed5470 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:32.637092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fc200679-fc50-4353-8508-58728478b0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:32.639978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1134/2276] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:32 2022] DELETE /identity/v3/projects/b74f75c7975445729af87e8dcbf6e564 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:32.642385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252336c9-265c-40c2-b391-8c047955c5d2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.642883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252336c9-265c-40c2-b391-8c047955c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.643581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252336c9-265c-40c2-b391-8c047955c5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.695946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-252336c9-265c-40c2-b391-8c047955c5d2 None None] MFA Rules not processed for user `f0dbcf81c947482d9d1012f7b6a92427`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:32.698758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-252336c9-265c-40c2-b391-8c047955c5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:32.756210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:32.758249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.758884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.759378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] PATH_INFO: `/v3/users/24dd40255cf0418fb59735127b1739bd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.761297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24dd40255cf0418fb59735127b1739bd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:32.763676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:32.809127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1135/2277] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:32.811264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d17d00-d487-4a94-8ee6-3c101f7f1b46 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.811669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d17d00-d487-4a94-8ee6-3c101f7f1b46 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.811956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d17d00-d487-4a94-8ee6-3c101f7f1b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.855287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-10d17d00-d487-4a94-8ee6-3c101f7f1b46 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:32.859378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-10d17d00-d487-4a94-8ee6-3c101f7f1b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:32.876547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:32.882296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1136/2278] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:32.890404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.890977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.891261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.914932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:32.916188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:32.935361 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1137/2279] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:32.936379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:32.946795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12614308-1205-4256-8b69-ce3ae2a01ea1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:32.952260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:32.953173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:32.955054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:32.955054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:32.955054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:32.955415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:32.957278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:32.980827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1138/2280] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:32.990730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:33.004251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4253-8e39-442c-b8f3-a970e34ea633 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:33.013736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:33.014509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:33.014883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:33.015228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:33.015988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:33.020004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24dd40255cf0418fb59735127b1739bd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:33.023128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:33.140008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24dd40255cf0418fb59735127b1739bd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:33.141490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24dd40255cf0418fb59735127b1739bd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:33.166653 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24dd40255cf0418fb59735127b1739bd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:33.167839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24dd40255cf0418fb59735127b1739bd'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:33.233240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1143/2281] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:32 2022] DELETE /identity/v3/users/24dd40255cf0418fb59735127b1739bd => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:33.246687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1139/2282] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:32 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:33.256718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:33.258531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:33.419039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e315-a0ed-4ce5-9ab3-103090b5cff1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:33.585167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:33.585919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:33.586234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:33.586547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:33.587273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:33.589389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:33.792890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:33.800277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1144/2283] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:33 2022] POST /identity/v3/users => generated 286 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:33.809311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cc5d5-0c65-440c-aeed-257ad3fd0fe9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:33.817575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:33.820016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:33.820016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:33.820846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:33.821818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:33.823923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:33.852216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1140/2284] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:33.859742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:33.883860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b64a1-5332-452d-8dc7-137bdabf4725 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:33.915501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:33.917393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:33.917823 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:33.920736 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:33.948389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:33.952650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:33.996444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1145/2285] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:19:34.004109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:34.027574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78c2d-a449-4edd-8a39-9d9e4a30ab06 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:34.039168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183645ec-8bc4-4fe8-95dd-1a862fdcf99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:34.040458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183645ec-8bc4-4fe8-95dd-1a862fdcf99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.041063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183645ec-8bc4-4fe8-95dd-1a862fdcf99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.042256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183645ec-8bc4-4fe8-95dd-1a862fdcf99c admin admin] PATH_INFO: `/v3/projects/ce4cb1ad92e24a0da2b23d6e4fcb45a5/users/02581d893931416b8c7a93635b9016ae/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.062375 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:34.064432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:34.077022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183645ec-8bc4-4fe8-95dd-1a862fdcf99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4cb1ad92e24a0da2b23d6e4fcb45a5, user_id=02581d893931416b8c7a93635b9016ae, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:34.084203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183645ec-8bc4-4fe8-95dd-1a862fdcf99c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:34.098200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b76c7-d7d2-436d-af44-a842138c28c2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:34.109896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:34.109896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.109896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.109896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] PATH_INFO: `/v3/projects/38a16b974ad7456db9723f64e71bf950` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.111128 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a16b974ad7456db9723f64e71bf950)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:34.114101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:34.172835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1141/2286] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:34 2022] PUT /identity/v3/projects/ce4cb1ad92e24a0da2b23d6e4fcb45a5/users/02581d893931416b8c7a93635b9016ae/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:34.180594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.181458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.182218 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.211464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:34.213693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:34.311661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a16b974ad7456db9723f64e71bf950', 'request_id': 'req-7934f485-fe5d-4810-b1d6-0552e3f05742'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:34.431368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a16b974ad7456db9723f64e71bf950', 'request_id': 'req-7934f485-fe5d-4810-b1d6-0552e3f05742'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:34.441395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a16b974ad7456db9723f64e71bf950', 'request_id': 'req-7934f485-fe5d-4810-b1d6-0552e3f05742'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:34.455978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1142/2287] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:34.464359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:34.466067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] The token cache is being invalidate because project 38a16b974ad7456db9723f64e71bf950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:34.466486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:34.466829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:34.467363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7934f485-fe5d-4810-b1d6-0552e3f05742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:34.471465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1146/2288] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:34 2022] DELETE /identity/v3/projects/38a16b974ad7456db9723f64e71bf950 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:34.482956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa27a7-8aae-4c97-ad44-a38b04062f1f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.483475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa27a7-8aae-4c97-ad44-a38b04062f1f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.483880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa27a7-8aae-4c97-ad44-a38b04062f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.547562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d8aa27a7-8aae-4c97-ad44-a38b04062f1f None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:34.550979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d8aa27a7-8aae-4c97-ad44-a38b04062f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:34.584380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c887-22cc-4470-bc7c-fa20cc4ab95e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:34.666668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:34.707718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:34.707718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.708736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.710161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.718300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:34.731956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:34.751989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1147/2289] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:34.762561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.762994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.763424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.797647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:34.799114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:34.820498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1148/2290] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:34.838003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:34.852045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1905-5594-4494-b2b4-85072ee1de04 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:34.862737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:34.863398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.865686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.865686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.865686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:34.865686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:34.867861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:34.878998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:34.885626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:34.890211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1149/2291] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:19:34.895611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:34.908497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac163d2-9a52-4850-88f1-bc7f9817e6f8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:34.913741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1143/2292] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:34.915501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:34.916324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:34.916716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:34.917140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:34.917945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:34.920431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:35.102751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1150/2293] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:34 2022] POST /identity/v3/projects => generated 407 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:35.103784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:35.121516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487bbf1-72b2-46ea-a381-e0684eaa9268 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:35.296653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:35.297794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:35.298513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:35.298987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:35.299930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:35.304418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:35.430696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1144/2294] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:35 2022] POST /identity/v3/users => generated 304 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:35.436678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:35.471588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099770b3-dd84-4bfb-a1d9-5946177d967d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:35.480596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:35.481858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:35.482311 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:35.483827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:35.485337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:35.488492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:35.516833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1151/2295] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:35.520854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:35.539074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400ac9-ddc3-4060-822f-756b6dcead96 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:35.552247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4c9a0-21f1-4509-96b9-83a1374e99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:35.553182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c9a0-21f1-4509-96b9-83a1374e99fa admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:35.553715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c9a0-21f1-4509-96b9-83a1374e99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:35.554131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c9a0-21f1-4509-96b9-83a1374e99fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:35.555207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4c9a0-21f1-4509-96b9-83a1374e99fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:35.560363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4c9a0-21f1-4509-96b9-83a1374e99fa admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:35.580913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1145/2296] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:35.588501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:35.607163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0552f3-ef78-4d62-b75a-7458377da181 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:35.617174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:35.625041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:35.626417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:35.626886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:35.627485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] PATH_INFO: `/v3/projects/eca9bda7562342de88b55d16e2e72d8d/users/3f00aca1d9294acebf83eb5b9f1f6111/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:35.656043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca9bda7562342de88b55d16e2e72d8d, user_id=3f00aca1d9294acebf83eb5b9f1f6111, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:35.661135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:35.762697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:35.777379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1152/2297] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:35 2022] PUT /identity/v3/projects/eca9bda7562342de88b55d16e2e72d8d/users/3f00aca1d9294acebf83eb5b9f1f6111/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:35.789607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:35.789974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:35.790443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:35.847598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] MFA Rules not processed for user `3f00aca1d9294acebf83eb5b9f1f6111`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:35.869248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:36.035002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1146/2298] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:36.040661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:36.318280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86889981-6340-4f63-a609-24e1cba8edcc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:36.329846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:36.330794 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:36.331832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:36.332219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:36.337025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:36.342338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:36.487817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1153/2299] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:36 2022] POST /identity/v3/projects => generated 407 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:36.495436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:36.519249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fb921-18b8-4e30-ae7f-5d45afb1c4cf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:36.597747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:36.646382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:36.648013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:36.648330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:36.649155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:36.649801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:36.652487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:36.837922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1147/2300] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:36 2022] POST /identity/v3/users => generated 310 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:19:36.843349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:36.899440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124d4a-06de-481a-a50e-c1c2d51696c8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:36.911313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:36.912545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:36.915414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:36.915952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:36.917472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:36.922642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:37.007252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1154/2301] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:37.007572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:37.007572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd69725-da80-4072-81bf-9b7065077606 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:37.007572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648fa8c-260e-466d-901f-d2cf8c285638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:37.007572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648fa8c-260e-466d-901f-d2cf8c285638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:37.007917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648fa8c-260e-466d-901f-d2cf8c285638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:37.007917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648fa8c-260e-466d-901f-d2cf8c285638 admin admin] PATH_INFO: `/v3/projects/361cc247254d4a96bc4db632728b3c82/users/d9a38cb85a624e5a9e475a3ca4bf0913/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:37.021847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648fa8c-260e-466d-901f-d2cf8c285638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361cc247254d4a96bc4db632728b3c82, user_id=d9a38cb85a624e5a9e475a3ca4bf0913, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:37.025066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648fa8c-260e-466d-901f-d2cf8c285638 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:37.382850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1148/2302] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:36 2022] PUT /identity/v3/projects/361cc247254d4a96bc4db632728b3c82/users/d9a38cb85a624e5a9e475a3ca4bf0913/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:37.384151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:37.397529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629a689-3835-4ea8-9c50-b017fa6e2a24 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:37.421464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a252d-40f4-4e4c-afdc-8dc9140df926 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:37.421952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a252d-40f4-4e4c-afdc-8dc9140df926 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:37.422417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a252d-40f4-4e4c-afdc-8dc9140df926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:37.457255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7f9a252d-40f4-4e4c-afdc-8dc9140df926 None None] MFA Rules not processed for user `5c77b5c6be6b416da83b907f2bb098ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:37.460485 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7f9a252d-40f4-4e4c-afdc-8dc9140df926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:37.471952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:37.472926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:37.473183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:37.473628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:37.474532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:37.477232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:37.495867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1155/2303] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:37.497941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:37.518760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74221e-0e82-430f-af17-399fd32caf56 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:37.525019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82621982-f84c-4658-a366-aae8a2e7f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:37.526209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621982-f84c-4658-a366-aae8a2e7f743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:37.526646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621982-f84c-4658-a366-aae8a2e7f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:37.526791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621982-f84c-4658-a366-aae8a2e7f743 admin admin] PATH_INFO: `/v3/projects/361cc247254d4a96bc4db632728b3c82/users/d9a38cb85a624e5a9e475a3ca4bf0913/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:37.529440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82621982-f84c-4658-a366-aae8a2e7f743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361cc247254d4a96bc4db632728b3c82, user_id=d9a38cb85a624e5a9e475a3ca4bf0913, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:37.532914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82621982-f84c-4658-a366-aae8a2e7f743 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:37.557306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1156/2304] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:37 2022] PUT /identity/v3/projects/361cc247254d4a96bc4db632728b3c82/users/d9a38cb85a624e5a9e475a3ca4bf0913/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:37.559499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:37.559499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:37.559991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:37.575178 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:37.613247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] MFA Rules not processed for user `d9a38cb85a624e5a9e475a3ca4bf0913`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:37.615495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:37.637386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1149/2305] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:37.783432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:37.783729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:37.785436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:37.856746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1157/2306] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:37 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:37.869510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:37.870450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:37.950918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] MFA Rules not processed for user `02581d893931416b8c7a93635b9016ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:37.954472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:38.159424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81c1e1-85c9-469a-9346-e348d4ae1c24 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:38.187913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:38.188620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:38.188974 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:38.189356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:38.227091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:38.243415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:38.289259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1158/2307] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:37 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:19:38.347220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1150/2308] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:38.433687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:38.437079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:38.454851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc02d8e-a8cd-4136-aeba-d771325485a9 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:38.482709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558fc83-c24f-4893-83f1-48517cdd7932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:38.484710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558fc83-c24f-4893-83f1-48517cdd7932 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:38.486509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558fc83-c24f-4893-83f1-48517cdd7932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:38.486972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558fc83-c24f-4893-83f1-48517cdd7932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:38.526847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558fc83-c24f-4893-83f1-48517cdd7932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:38.539244 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558fc83-c24f-4893-83f1-48517cdd7932 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:38.613346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1159/2309] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:39.154888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:39.158403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:39.187067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b566d-cdae-4674-8f85-732f2874a703 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:39.201836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685dc10-1cd7-4835-965d-6e00f6f1e1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:39.202200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685dc10-1cd7-4835-965d-6e00f6f1e1cd service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:39.202362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685dc10-1cd7-4835-965d-6e00f6f1e1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:39.202682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685dc10-1cd7-4835-965d-6e00f6f1e1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:39.484973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685dc10-1cd7-4835-965d-6e00f6f1e1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:39.489194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685dc10-1cd7-4835-965d-6e00f6f1e1cd service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:39.585471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1151/2310] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:39.858501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:40.221909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:40.222860 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:40.223668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:40.271372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] MFA Rules not processed for user `4b79ded3ff9146948803b1e63994a225`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:40.273590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:40.405614 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1160/2311] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:40.674121 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:41.277954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3a6e3-cc09-4947-997c-20f4a1d6f92e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:41.279580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3a6e3-cc09-4947-997c-20f4a1d6f92e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:41.280262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3a6e3-cc09-4947-997c-20f4a1d6f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:41.332552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-99f3a6e3-cc09-4947-997c-20f4a1d6f92e None None] MFA Rules not processed for user `02581d893931416b8c7a93635b9016ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:41.334260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99f3a6e3-cc09-4947-997c-20f4a1d6f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:41.353924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1152/2312] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:42.284900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:43.513858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:45.905838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:46.328392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:46.609108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:47.168710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:47.501433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:48.226656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:48.808900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:50.907850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:51.431181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:52.739805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:52.838864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:53.792498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:53.973524 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f34f0-9b50-4114-8538-856f7055aced None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:53.983318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:53.986792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:53.992546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:53.992546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] PATH_INFO: `/v3/users/3f00aca1d9294acebf83eb5b9f1f6111` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:53.992546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f00aca1d9294acebf83eb5b9f1f6111)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:53.994755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:54.387798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f00aca1d9294acebf83eb5b9f1f6111'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:54.500151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f00aca1d9294acebf83eb5b9f1f6111'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:54.500895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f00aca1d9294acebf83eb5b9f1f6111'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:54.514295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f00aca1d9294acebf83eb5b9f1f6111'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:54.515781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f00aca1d9294acebf83eb5b9f1f6111'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:54.581370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1161/2313] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:53 2022] DELETE /identity/v3/users/3f00aca1d9294acebf83eb5b9f1f6111 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:54.585978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:54.586575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:54.586575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:54.613276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:54.614953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:54.769310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1153/2314] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:54.779242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:54.792253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:54.795393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:54.924468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:54.964723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673c17-69ec-43fd-a0a9-e0fb3d11124f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:54.975076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:54.977686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:54.978513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:54.979274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:55.001959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:55.005000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:55.028618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1162/2315] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:19:55.839954 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:55.850712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:55.900745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9607d-8b8b-4e02-8fe3-876ff2f59a01 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:55.913676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:55.919520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:55.919520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:55.919520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] PATH_INFO: `/v3/projects/eca9bda7562342de88b55d16e2e72d8d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:55.919520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca9bda7562342de88b55d16e2e72d8d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:55.919520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:56.087419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca9bda7562342de88b55d16e2e72d8d', 'request_id': 'req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.106112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca9bda7562342de88b55d16e2e72d8d', 'request_id': 'req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.119303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca9bda7562342de88b55d16e2e72d8d', 'request_id': 'req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.209813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] The token cache is being invalidate because project eca9bda7562342de88b55d16e2e72d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:56.210304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.211011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.212931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1154/2316] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:55 2022] DELETE /identity/v3/projects/eca9bda7562342de88b55d16e2e72d8d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:56.217578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:56.230778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b1d0e-578a-4dd8-87d7-60ae75983dbc service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:56.302188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:56.303347 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:56.304279 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:56.305063 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] PATH_INFO: `/v3/users/d9a38cb85a624e5a9e475a3ca4bf0913` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:56.306652 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a38cb85a624e5a9e475a3ca4bf0913)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:56.308876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:56.562636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a38cb85a624e5a9e475a3ca4bf0913'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.671629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a38cb85a624e5a9e475a3ca4bf0913'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.672497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a38cb85a624e5a9e475a3ca4bf0913'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.684428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a38cb85a624e5a9e475a3ca4bf0913'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.685618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-076e1830-9394-46cd-a9a7-0bc8c2665f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a38cb85a624e5a9e475a3ca4bf0913'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:56.730915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1163/2317] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:19:56 2022] DELETE /identity/v3/users/d9a38cb85a624e5a9e475a3ca4bf0913 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:57.196561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:57.317164 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:57.906836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:57.908635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:57.924615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90d0f-74a1-42ab-94b9-8dbe7b07eecc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:58.033441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:58.035329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:58.035868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:58.038185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] PATH_INFO: `/v3/projects/361cc247254d4a96bc4db632728b3c82` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:58.041290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361cc247254d4a96bc4db632728b3c82)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:58.043900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:58.253850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361cc247254d4a96bc4db632728b3c82', 'request_id': 'req-b31c63ef-2de5-4628-8d47-a4bfa8baea25'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:58.260549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361cc247254d4a96bc4db632728b3c82', 'request_id': 'req-b31c63ef-2de5-4628-8d47-a4bfa8baea25'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:58.267725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361cc247254d4a96bc4db632728b3c82', 'request_id': 'req-b31c63ef-2de5-4628-8d47-a4bfa8baea25'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:58.391468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] The token cache is being invalidate because project 361cc247254d4a96bc4db632728b3c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:19:58.391799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:58.392562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b31c63ef-2de5-4628-8d47-a4bfa8baea25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:19:58.394312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1155/2318] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:19:57 2022] DELETE /identity/v3/projects/361cc247254d4a96bc4db632728b3c82 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:19:58.400468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:58.401627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:58.401627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:58.421496 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:58.425013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:58.509064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1164/2319] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:58.525056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:58.525532 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:58.526019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:58.579165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:58.581299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:58.597921 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1156/2320] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:19:58.603779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:58.629247 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465490b0-a1a5-4bca-9474-70d71967b751 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:58.641212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:58.642773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:58.643492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:58.644189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:58.645780 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:19:58.647822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:58.652207 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:58.690384 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:58.701904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1165/2321] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:19:58.712995 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b345c2-5437-4853-9392-e04a58e6d3c3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:58.721946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:58.723061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:58.723552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:58.724049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:58.726956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:58.731179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:58.823833 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:58.899794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1157/2322] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:19:58 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:58.904550 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:58.919961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715897-116b-480d-bb93-04a160f94c84 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:59.021400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:59.023140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:59.023630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:59.024118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:59.025452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:59.029677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:59.100414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:19:59.180049 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:59.181358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1166/2323] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:19:58 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:19:59.193181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93d42c-066a-4577-a1e2-7915afeeffa2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:59.199573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:59.200827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:59.200827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:59.206515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:59.206515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:59.206515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:59.221731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1158/2324] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:59.226139 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:59.248042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262b9f1-c9db-47b9-b4e9-040bcb462b54 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:59.253871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef61e32-4936-4bb4-8d88-785684a0fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:59.254558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef61e32-4936-4bb4-8d88-785684a0fadc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:59.254841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef61e32-4936-4bb4-8d88-785684a0fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:59.255303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef61e32-4936-4bb4-8d88-785684a0fadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:59.256270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef61e32-4936-4bb4-8d88-785684a0fadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:59.258392 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef61e32-4936-4bb4-8d88-785684a0fadc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:59.276442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:59.276973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1167/2325] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:19:59.299263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97538a1d-7e9d-4e8d-ba6b-c0a2ac3d912d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:59.302456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:59.303714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:59.303996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:59.304270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] PATH_INFO: `/v3/projects/7e9284fd80c54bcdaf0673e6dc265886/users/cf93ed6f1a2442d1a4ead14b71d4a140/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:59.331779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9284fd80c54bcdaf0673e6dc265886, user_id=cf93ed6f1a2442d1a4ead14b71d4a140, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:59.337984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:59.415875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1159/2326] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:19:59 2022] PUT /identity/v3/projects/7e9284fd80c54bcdaf0673e6dc265886/users/cf93ed6f1a2442d1a4ead14b71d4a140/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:19:59.429732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459a58b-d2f7-4fcd-b08b-429ac674dfc4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:59.430310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459a58b-d2f7-4fcd-b08b-429ac674dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:59.430310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459a58b-d2f7-4fcd-b08b-429ac674dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:59.462658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4459a58b-d2f7-4fcd-b08b-429ac674dfc4 None None] MFA Rules not processed for user `cf93ed6f1a2442d1a4ead14b71d4a140`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:19:59.464214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4459a58b-d2f7-4fcd-b08b-429ac674dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:59.639743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1168/2327] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:19:59.649236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:19:59.651471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:19:59.765574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f59cc7-61bc-4520-85e7-4dfa60db637f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:19:59.769846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14b9ea-5b2d-4415-9742-289914fb9d29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:19:59.770526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b9ea-5b2d-4415-9742-289914fb9d29 service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:19:59.770811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b9ea-5b2d-4415-9742-289914fb9d29 service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:19:59.771088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14b9ea-5b2d-4415-9742-289914fb9d29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:19:59.782106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14b9ea-5b2d-4415-9742-289914fb9d29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:19:59.783274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14b9ea-5b2d-4415-9742-289914fb9d29 service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:19:59.796539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1160/2328] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:19:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:20:00.071525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb9ac2-91f4-49da-b9d9-316227e3c73c None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:00.072175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb9ac2-91f4-49da-b9d9-316227e3c73c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:00.072822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb9ac2-91f4-49da-b9d9-316227e3c73c None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:00.077200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1169/2329] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:20:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:20:00.106070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab4706-be42-43ab-a3e5-4f27b7ac0fc3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:00.107144 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab4706-be42-43ab-a3e5-4f27b7ac0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:00.108453 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab4706-be42-43ab-a3e5-4f27b7ac0fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:00.194024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d9ab4706-be42-43ab-a3e5-4f27b7ac0fc3 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:00.195572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d9ab4706-be42-43ab-a3e5-4f27b7ac0fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:00.389938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1161/2330] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:20:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:00.410679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb9ac2-91f4-49da-b9d9-316227e3c73c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:00.413889 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-66cb9ac2-91f4-49da-b9d9-316227e3c73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:00.430856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb9ac2-91f4-49da-b9d9-316227e3c73c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:00.441017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9781b6-70d2-48cb-9f8a-40fbd93d817e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:00.442258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9781b6-70d2-48cb-9f8a-40fbd93d817e service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:00.442990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9781b6-70d2-48cb-9f8a-40fbd93d817e service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:00.443667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9781b6-70d2-48cb-9f8a-40fbd93d817e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:00.463408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9781b6-70d2-48cb-9f8a-40fbd93d817e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:00.466837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9781b6-70d2-48cb-9f8a-40fbd93d817e service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:00.495719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1170/2331] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:20:00.798726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d6d9-3a01-413d-991b-7d8bdda849b6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:00.799038 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d6d9-3a01-413d-991b-7d8bdda849b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:00.799294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d6d9-3a01-413d-991b-7d8bdda849b6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:00.801351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1162/2332] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:20:00.826745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fab12-9d53-46e0-b461-cdc10ef7cc11 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:00.828465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fab12-9d53-46e0-b461-cdc10ef7cc11 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:00.828465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fab12-9d53-46e0-b461-cdc10ef7cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:00.859156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a44fab12-9d53-46e0-b461-cdc10ef7cc11 None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:00.861788 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a44fab12-9d53-46e0-b461-cdc10ef7cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:00.941868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1171/2333] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:20:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:00.961102 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d6d9-3a01-413d-991b-7d8bdda849b6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:00.965484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6652d6d9-3a01-413d-991b-7d8bdda849b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:00.987939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d6d9-3a01-413d-991b-7d8bdda849b6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:00.992876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3d457-6c45-45a4-9c9f-551677b3350b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:00.993860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d457-6c45-45a4-9c9f-551677b3350b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:00.994127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d457-6c45-45a4-9c9f-551677b3350b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:00.994558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d457-6c45-45a4-9c9f-551677b3350b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:01.005603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d457-6c45-45a4-9c9f-551677b3350b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:01.013015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d457-6c45-45a4-9c9f-551677b3350b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:01.020478 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1163/2334] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:20:01.185634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6a3e1-d192-4f08-8ac2-79892cecd7c9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:01.186131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6a3e1-d192-4f08-8ac2-79892cecd7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:01.186605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6a3e1-d192-4f08-8ac2-79892cecd7c9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:01.189720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1172/2335] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:20:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 14:20:01.205559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea17d58-56a6-4133-ab5c-ea93717b5eb1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:01.205839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea17d58-56a6-4133-ab5c-ea93717b5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:01.206327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea17d58-56a6-4133-ab5c-ea93717b5eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:01.240829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bea17d58-56a6-4133-ab5c-ea93717b5eb1 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:01.243184 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bea17d58-56a6-4133-ab5c-ea93717b5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:01.263296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1164/2336] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:01.278785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6a3e1-d192-4f08-8ac2-79892cecd7c9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:01.292563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6a3e1-d192-4f08-8ac2-79892cecd7c9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:01.296944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:01.297624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:01.297925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:01.298210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:01.309952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:01.311601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:01.326100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1173/2337] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:20:01.615123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:01.797384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:02.968345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:03.391371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:03.982091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:04.888338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:05.010410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:06.443691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:06.505698 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:06.784636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:06.803537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:07.259449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:07.316580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:07.355969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:07.628889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:07.671965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.066211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.231563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.265367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.374365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.402752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.550591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.739626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:08.918813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.061549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.203170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.269519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.412917 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.460054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.550984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.719631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:09.791725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:10.032511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:10.064300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:10.349220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:10.603062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:10.923925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:11.022773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:11.168376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:16.967580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8bcd-e878-4840-ae93-ed94b902dab7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:16.968867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8bcd-e878-4840-ae93-ed94b902dab7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:16.968867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8bcd-e878-4840-ae93-ed94b902dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:17.004392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-190e8bcd-e878-4840-ae93-ed94b902dab7 None None] MFA Rules not processed for user `02581d893931416b8c7a93635b9016ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:17.007655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-190e8bcd-e878-4840-ae93-ed94b902dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:17.036439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:17.088419 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1165/2338] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:17.209803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:17.219593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e15a17-d2fa-43a6-bd70-4da3c2de48c0 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:17.223479 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:17.224852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:17.225057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:17.225358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:17.227268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:17.303667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:17.317177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:17.321672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:17.330109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1174/2339] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:20:18.112914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:18.113492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:18.113492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:18.178480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:18.179757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:18.288622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1166/2340] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:18.301019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:18.302520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:18.477088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e0263-8d97-4080-a6e3-7b78e8b48f3d service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:18.482796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:18.483455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:18.483743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:18.484343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:18.494328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:18.498407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:18.507544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1175/2341] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:20:28.276180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=54 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:28.503134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=45 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:30.879625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:30.882684 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:30.994672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe3f3-785b-4188-b6a2-cbeda4b8884f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:31.001544 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:31.002709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:31.003463 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:31.004054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:31.008927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:31.033071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:31.036174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d00c7-747d-426a-a223-8ce420d70669 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:31.055241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1167/2342] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:20:31.120954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:31.206321 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c9afd-de31-41e2-b468-e072afff01cc service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:31.213371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:31.214945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:31.215458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:31.215947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] PATH_INFO: `/v3/users/cf93ed6f1a2442d1a4ead14b71d4a140` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:31.222243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf93ed6f1a2442d1a4ead14b71d4a140)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:31.224455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:31.528259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf93ed6f1a2442d1a4ead14b71d4a140'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:31.626204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf93ed6f1a2442d1a4ead14b71d4a140'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:31.630467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf93ed6f1a2442d1a4ead14b71d4a140'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:31.646634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf93ed6f1a2442d1a4ead14b71d4a140'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:31.648335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf93ed6f1a2442d1a4ead14b71d4a140'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:31.716328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1176/2343] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:20:31 2022] DELETE /identity/v3/users/cf93ed6f1a2442d1a4ead14b71d4a140 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:20:31.720890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:31.721250 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:31.721771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:31.758953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:31.761539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:31.852647 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1168/2344] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:31.865122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:31.867703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:31.936315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271594d2-0a94-4b6a-9618-3e52270cd925 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:31.940077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a00d8-8d5d-4b95-a692-ad55bcd1d14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:31.940773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a00d8-8d5d-4b95-a692-ad55bcd1d14a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:31.941091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a00d8-8d5d-4b95-a692-ad55bcd1d14a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:31.941373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a00d8-8d5d-4b95-a692-ad55bcd1d14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:31.953238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a00d8-8d5d-4b95-a692-ad55bcd1d14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:31.954716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a00d8-8d5d-4b95-a692-ad55bcd1d14a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:31.966999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1177/2345] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:20:32.586204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:32.587755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:32.602373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a1ff6-685e-4fed-8d20-78f04373c83c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:32.608164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:32.609627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:32.610074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:32.612517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] PATH_INFO: `/v3/projects/7e9284fd80c54bcdaf0673e6dc265886` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:32.614642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9284fd80c54bcdaf0673e6dc265886)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:32.617594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:32.863574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9284fd80c54bcdaf0673e6dc265886', 'request_id': 'req-fb2887ab-e156-4eb4-88f4-89b538e85326'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:32.872385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9284fd80c54bcdaf0673e6dc265886', 'request_id': 'req-fb2887ab-e156-4eb4-88f4-89b538e85326'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:32.883918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9284fd80c54bcdaf0673e6dc265886', 'request_id': 'req-fb2887ab-e156-4eb4-88f4-89b538e85326'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:32.893385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:33.014855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] The token cache is being invalidate because project 7e9284fd80c54bcdaf0673e6dc265886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:20:33.015140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:33.015806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fb2887ab-e156-4eb4-88f4-89b538e85326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:33.017585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1169/2346] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:20:32 2022] DELETE /identity/v3/projects/7e9284fd80c54bcdaf0673e6dc265886 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:20:33.025020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.025600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.025600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.046883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:33.048399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:33.077154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:33.152873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1178/2347] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:33.163552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.164070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.164597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.203262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:33.204911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:33.215137 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1170/2348] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:33.219930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:33.243811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec02b5-79e2-41a4-ae89-831c9323f2f3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:33.250223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:33.251532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.251532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.252017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.253295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:20:33.253849 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:33.255629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:33.270108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1179/2349] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:20:33.274634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:33.286408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1cd50-3bd7-45da-99a6-6160034cf549 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:33.292180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:33.292894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.293205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.293481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.294359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:33.296298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:33.431557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1171/2350] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:20:33 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:20:33.433190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:33.445761 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972e4b-7c27-4ea0-b52b-b05f68f07c46 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:33.524556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:33.526486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.526486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.526486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.527027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:33.529141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:33.649571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1180/2351] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:20:33 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:20:33.654114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:33.667344 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34956d-f6ae-402e-a69f-5120afc99a1c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:33.673170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:33.673872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.674262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.674640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.675460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:33.677228 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:33.689130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1172/2352] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:20:33.693310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:33.704538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24f544-fcd1-4db2-9ffb-b974033a6562 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:33.710540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208190b-e932-4076-8b4c-e37717eb4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:33.711396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208190b-e932-4076-8b4c-e37717eb4601 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.711638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208190b-e932-4076-8b4c-e37717eb4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.711915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208190b-e932-4076-8b4c-e37717eb4601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.712658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208190b-e932-4076-8b4c-e37717eb4601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:33.714378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208190b-e932-4076-8b4c-e37717eb4601 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:33.726939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1181/2353] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:20:33.731482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:33.742738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29e79-6ca7-41cb-ae1e-1acb107194b7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:33.750533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:33.758828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.758828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.758828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] PATH_INFO: `/v3/projects/c3ee934ea82448649b17a9f14517acf5/users/bb8db717d4b54aaeb0a2872e4c7d4d96/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.775031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ee934ea82448649b17a9f14517acf5, user_id=bb8db717d4b54aaeb0a2872e4c7d4d96, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:33.779128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:33.931518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1173/2354] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:20:33 2022] PUT /identity/v3/projects/c3ee934ea82448649b17a9f14517acf5/users/bb8db717d4b54aaeb0a2872e4c7d4d96/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:20:33.946000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9435d6-39be-4a1a-b755-36f29cf94b4b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:33.946306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9435d6-39be-4a1a-b755-36f29cf94b4b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:33.946592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9435d6-39be-4a1a-b755-36f29cf94b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:33.977520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cc9435d6-39be-4a1a-b755-36f29cf94b4b None None] MFA Rules not processed for user `bb8db717d4b54aaeb0a2872e4c7d4d96`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:33.978726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cc9435d6-39be-4a1a-b755-36f29cf94b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:34.070787 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1182/2355] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:34.083092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:34.085931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:34.176922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651a335-adae-494e-b29d-2b56aa23972e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:34.187624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:34.188773 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:34.189215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:34.189518 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:34.202420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:34.202420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:34.213509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1174/2356] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:20:43.860777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:43.861371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:43.861467 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:43.882389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:43.883684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:43.904265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:43.962626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1183/2357] 10.222.0.71 () {58 vars in 967 bytes} [Wed May 18 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:43.988984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:43.991742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:44.067886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae262d2-2d6b-4b41-909c-031cb74be85c service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:44.075841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be442da3-96ee-4f3e-be84-eb0439c771b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:44.081134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442da3-96ee-4f3e-be84-eb0439c771b9 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:44.081134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442da3-96ee-4f3e-be84-eb0439c771b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:44.081134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be442da3-96ee-4f3e-be84-eb0439c771b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:44.087430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be442da3-96ee-4f3e-be84-eb0439c771b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:44.089077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be442da3-96ee-4f3e-be84-eb0439c771b9 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:44.099382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1175/2358] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:20:45.157508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:45.237417 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f4d8-c42f-4f8a-a99b-71725f2157ba None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:45.243288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:45.244155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:45.244421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:45.244694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] PATH_INFO: `/v3/users/bb8db717d4b54aaeb0a2872e4c7d4d96` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:45.246034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8db717d4b54aaeb0a2872e4c7d4d96)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:45.247977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:45.494085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8db717d4b54aaeb0a2872e4c7d4d96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:45.666386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8db717d4b54aaeb0a2872e4c7d4d96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:45.667115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8db717d4b54aaeb0a2872e4c7d4d96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:45.677446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8db717d4b54aaeb0a2872e4c7d4d96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:45.680885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8db717d4b54aaeb0a2872e4c7d4d96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:45.706478 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1184/2359] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:20:45 2022] DELETE /identity/v3/users/bb8db717d4b54aaeb0a2872e4c7d4d96 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:20:45.712427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:45.712993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:45.713132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:45.733871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:45.735284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:45.777743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:45.833147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1176/2360] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:45.843704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:45.845360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:45.901036 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:45.913683 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650405-3dab-4beb-a4ff-6a322f4be124 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:45.918005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13b375-3234-4c65-b093-e9057ded2be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:45.918778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b375-3234-4c65-b093-e9057ded2be2 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:45.919060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b375-3234-4c65-b093-e9057ded2be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:45.920366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13b375-3234-4c65-b093-e9057ded2be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:45.934007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13b375-3234-4c65-b093-e9057ded2be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:45.935665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13b375-3234-4c65-b093-e9057ded2be2 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:45.947275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1185/2361] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:20:46.512815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:46.514321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:46.528291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c1f45-eba9-4c09-9ae5-d2bc322b5323 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:46.533591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:46.534514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:46.534792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:46.535080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] PATH_INFO: `/v3/projects/c3ee934ea82448649b17a9f14517acf5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:46.537270 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ee934ea82448649b17a9f14517acf5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:46.541238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:46.687335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ee934ea82448649b17a9f14517acf5', 'request_id': 'req-1a116c07-8daf-49be-afe2-d3ed01511138'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:46.693996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ee934ea82448649b17a9f14517acf5', 'request_id': 'req-1a116c07-8daf-49be-afe2-d3ed01511138'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:46.701845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ee934ea82448649b17a9f14517acf5', 'request_id': 'req-1a116c07-8daf-49be-afe2-d3ed01511138'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:46.837118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] The token cache is being invalidate because project c3ee934ea82448649b17a9f14517acf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:20:46.837690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:46.838190 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a116c07-8daf-49be-afe2-d3ed01511138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:20:46.840280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1177/2362] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:20:46 2022] DELETE /identity/v3/projects/c3ee934ea82448649b17a9f14517acf5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:20:46.845257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:46.845717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:46.851906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:46.865978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:46.867208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:46.936101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1186/2363] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:46.944480 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:46.944741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:46.945059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:46.964933 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:46.966173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:46.974726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1178/2364] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:46.978929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:46.988857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e184-f215-4cc1-ae43-f54acb5df5d5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:46.994448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:46.995127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:46.995407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:46.995679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:46.996413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:20:46.996720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:46.998369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.015265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1187/2365] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:20:47.016533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:47.027288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967692bb-2625-4bbb-9930-c0267220dd68 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:47.031983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:47.032640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.032957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.033234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.033924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:47.035829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.135606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1179/2366] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:20:47 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:20:47.139799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:47.150047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990a0e2-9035-4524-bf28-bf9ebb3afa81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:47.209820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:47.210457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.210738 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.211019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.211707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:47.213672 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.362127 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1188/2367] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:20:47 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:20:47.366309 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:47.376562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa6409-16b0-417a-a4f8-5bb2e0fc1ebb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:47.382014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:47.382865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.383182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.383446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.384182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:47.385899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.405371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1180/2368] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:20:47.406855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:47.420908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c09c3-c71b-4e3d-94d8-ef46a2586a0f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:47.425904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801cd37-83dc-4c5c-ac5d-f838993440ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:47.426572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801cd37-83dc-4c5c-ac5d-f838993440ba admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.426852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801cd37-83dc-4c5c-ac5d-f838993440ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.427126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801cd37-83dc-4c5c-ac5d-f838993440ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.427921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801cd37-83dc-4c5c-ac5d-f838993440ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:47.429574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801cd37-83dc-4c5c-ac5d-f838993440ba admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.441172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1189/2369] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:20:47.446300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:47.457120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede369-0594-431e-8a84-9975499bda08 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:47.463152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:47.464139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.464499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.464870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] PATH_INFO: `/v3/projects/608c4d6602754df0af0dc598e6275c9a/users/249d7c73a0cb44a9a9c6edc8a939ec87/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.487199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608c4d6602754df0af0dc598e6275c9a, user_id=249d7c73a0cb44a9a9c6edc8a939ec87, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:47.493991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.585117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1181/2370] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:20:47 2022] PUT /identity/v3/projects/608c4d6602754df0af0dc598e6275c9a/users/249d7c73a0cb44a9a9c6edc8a939ec87/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:20:47.595696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e49f-143e-4b32-8f24-ebe87a78d03d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.595983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e49f-143e-4b32-8f24-ebe87a78d03d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.596262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99e49f-143e-4b32-8f24-ebe87a78d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.627607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fe99e49f-143e-4b32-8f24-ebe87a78d03d None None] MFA Rules not processed for user `249d7c73a0cb44a9a9c6edc8a939ec87`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:20:47.628925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe99e49f-143e-4b32-8f24-ebe87a78d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:47.677629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:47.711775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1190/2371] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:20:47.739181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:20:47.739181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:20:47.786962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:47.801900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29f789-13ea-4ead-88e4-d0c92be16333 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:20:47.806416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:20:47.807083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:20:47.807370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:20:47.807639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:20:47.817180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:20:47.819281 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:20:47.829712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1182/2372] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:20:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:20:57.864180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:20:57.909476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:16.156072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:16.156844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:16.156982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:16.186146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:21:16.188398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:16.286195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1191/2373] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:21:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:21:16.299824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:16.301413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:16.415745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82847df-1416-498a-8a3d-d5df112a8bd3 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:16.422206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b86ce-3486-4065-82e0-0b3d6057b971 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:16.423415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b86ce-3486-4065-82e0-0b3d6057b971 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:16.423828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b86ce-3486-4065-82e0-0b3d6057b971 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:16.424306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b86ce-3486-4065-82e0-0b3d6057b971 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:16.440733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b86ce-3486-4065-82e0-0b3d6057b971 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:16.445642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b86ce-3486-4065-82e0-0b3d6057b971 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:16.454117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1183/2374] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:21:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:21:21.656963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:21.770948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b904376-f22a-46ba-98ca-38da31b562aa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:21.788458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:21.790038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:21.790563 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:21.791129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] PATH_INFO: `/v3/users/249d7c73a0cb44a9a9c6edc8a939ec87` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:21.794119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249d7c73a0cb44a9a9c6edc8a939ec87)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:21.815902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:22.119528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249d7c73a0cb44a9a9c6edc8a939ec87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:22.242469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249d7c73a0cb44a9a9c6edc8a939ec87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:22.243665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249d7c73a0cb44a9a9c6edc8a939ec87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:22.260924 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249d7c73a0cb44a9a9c6edc8a939ec87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:22.262246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249d7c73a0cb44a9a9c6edc8a939ec87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:22.301362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1192/2375] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:21:21 2022] DELETE /identity/v3/users/249d7c73a0cb44a9a9c6edc8a939ec87 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:21:22.305824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:22.308278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:22.309509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:22.342924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:21:22.344744 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:22.485575 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1184/2376] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:21:22.492855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:22.495359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:22.549826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:22.591630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823552b-8cfa-427e-8de9-d5ad2ff55506 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:22.599260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e639ae-e533-4ebb-b52c-cae1f9276830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:22.600865 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e639ae-e533-4ebb-b52c-cae1f9276830 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:22.601534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e639ae-e533-4ebb-b52c-cae1f9276830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:22.601881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e639ae-e533-4ebb-b52c-cae1f9276830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:22.614918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e639ae-e533-4ebb-b52c-cae1f9276830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:22.619624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e639ae-e533-4ebb-b52c-cae1f9276830 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:22.631027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1193/2377] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:21:23.429757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:23.433172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:23.455700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f41d9-94ca-4c92-b74c-52f82c85005d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:23.463214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:23.464976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:23.465458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:23.465906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] PATH_INFO: `/v3/projects/608c4d6602754df0af0dc598e6275c9a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:23.467875 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608c4d6602754df0af0dc598e6275c9a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:23.471282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:23.723787 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608c4d6602754df0af0dc598e6275c9a', 'request_id': 'req-b11a68f9-a8c6-48b3-911f-28ec9907ba12'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:23.731629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608c4d6602754df0af0dc598e6275c9a', 'request_id': 'req-b11a68f9-a8c6-48b3-911f-28ec9907ba12'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:23.739193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608c4d6602754df0af0dc598e6275c9a', 'request_id': 'req-b11a68f9-a8c6-48b3-911f-28ec9907ba12'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:23.832399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] The token cache is being invalidate because project 608c4d6602754df0af0dc598e6275c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:21:23.832701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:23.834018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:23.836375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1185/2378] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:21:23 2022] DELETE /identity/v3/projects/608c4d6602754df0af0dc598e6275c9a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:21:32.686931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=15 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:33.821198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:37.120360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8075a-eba3-40f4-89a9-c4060548bc4f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:37.121011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8075a-eba3-40f4-89a9-c4060548bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:37.121011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8075a-eba3-40f4-89a9-c4060548bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:37.142912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-98d8075a-eba3-40f4-89a9-c4060548bc4f None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:21:37.144186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98d8075a-eba3-40f4-89a9-c4060548bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:37.218658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1194/2379] 10.222.0.71 () {58 vars in 967 bytes} [Wed May 18 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:21:37.241164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:37.241164 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:37.322956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a68f9-a8c6-48b3-911f-28ec9907ba12 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:37.328908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:37.329585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:37.329889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:37.330167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:37.340282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:37.341667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:37.351304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1186/2380] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:21:37.356363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:37.356663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:37.357195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:37.380677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] MFA Rules not processed for user `f0dbcf81c947482d9d1012f7b6a92427`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:21:37.382055 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:37.441546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1195/2381] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:21:41.509465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:41.512876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:41.615839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ab8ea-9a8e-4233-9f9f-880cf857e6a1 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:41.624993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:41.626462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:41.626941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:41.627426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] PATH_INFO: `/v3/users/02581d893931416b8c7a93635b9016ae` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:41.629873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02581d893931416b8c7a93635b9016ae)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:41.634147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:41.854850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02581d893931416b8c7a93635b9016ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:41.856048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02581d893931416b8c7a93635b9016ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:41.857022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02581d893931416b8c7a93635b9016ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:41.955817 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02581d893931416b8c7a93635b9016ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:41.983978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-67aa3319-e656-40a1-a2f2-d5da677c109c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02581d893931416b8c7a93635b9016ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:42.007731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1187/2382] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:21:41 2022] DELETE /identity/v3/users/02581d893931416b8c7a93635b9016ae => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:21:42.348990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:21:42.380056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8b3b7-49f9-44eb-8413-d26bb810f527 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:21:42.469476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:21:42.470386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:42.470671 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:42.471276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] PATH_INFO: `/v3/projects/ce4cb1ad92e24a0da2b23d6e4fcb45a5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:42.472602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4cb1ad92e24a0da2b23d6e4fcb45a5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:21:42.474582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:21:42.590088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4cb1ad92e24a0da2b23d6e4fcb45a5', 'request_id': 'req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:42.592696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:42.675047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4cb1ad92e24a0da2b23d6e4fcb45a5', 'request_id': 'req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:42.684821 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4cb1ad92e24a0da2b23d6e4fcb45a5', 'request_id': 'req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:42.703149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] The token cache is being invalidate because project ce4cb1ad92e24a0da2b23d6e4fcb45a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:21:42.703633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:42.705006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bb2c5a0f-38cf-4556-a5d3-049f247c8fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:21:42.707985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1196/2383] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:21:42 2022] DELETE /identity/v3/projects/ce4cb1ad92e24a0da2b23d6e4fcb45a5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:21:51.999972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:52.934995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=3,keystone:SELECT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:21:56.565445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:21:56.566037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:21:56.566037 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:21:56.583942 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] MFA Rules not processed for user `b706a6c73a054e6ba4a22d413e1a3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:21:56.585187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:21:56.650233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1188/2384] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:22:00.449245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:00.449800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:00.449800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:00.467586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] MFA Rules not processed for user `5c77b5c6be6b416da83b907f2bb098ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:22:00.468896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:00.524592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1197/2385] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:22:06.643321 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=25 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:22:10.517887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:22:50.469337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:50.473436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:50.542125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4c41-fa0f-43c2-acf0-598b80ef6e06 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:50.546909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:50.547981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:50.548256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:50.548524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] PATH_INFO: `/v3/users/f0dbcf81c947482d9d1012f7b6a92427` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:50.550285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0dbcf81c947482d9d1012f7b6a92427)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:50.550413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:50.551879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:50.552207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:50.610091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c31c0-0859-4a6a-91d5-21f15bd3084a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:50.614327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:50.615068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:50.615352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:50.615625 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:50.617901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:50.630126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:50.631562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:50.641300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1198/2386] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:22:50.735189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0dbcf81c947482d9d1012f7b6a92427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:50.735872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0dbcf81c947482d9d1012f7b6a92427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:50.736469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0dbcf81c947482d9d1012f7b6a92427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:50.767813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:50.769675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:50.782192 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91c09-c05d-43c7-bc12-d366e1763d93 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:50.786477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:50.787046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:50.787328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:50.787603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:50.789481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:50.844926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0dbcf81c947482d9d1012f7b6a92427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:50.858476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0dbcf81c947482d9d1012f7b6a92427'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:50.870328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:50.871993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a787cb-e9fa-4aec-8bfe-e12c59284d18 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:50.873241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1189/2387] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:22:50 2022] DELETE /identity/v3/users/f0dbcf81c947482d9d1012f7b6a92427 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:22:50.886048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1199/2388] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:22:51.121690 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:51.123214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:51.201117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdf6bf-f396-440d-8677-e18fce3a8a3a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:51.206543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:51.209568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.209858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.210140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] PATH_INFO: `/v3/projects/bb4c33274e584df8a977aaf5c4add4be` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.211414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4c33274e584df8a977aaf5c4add4be)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:51.213371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:51.240839 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:22:51.360131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4c33274e584df8a977aaf5c4add4be', 'request_id': 'req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:51.365547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4c33274e584df8a977aaf5c4add4be', 'request_id': 'req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:51.371728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4c33274e584df8a977aaf5c4add4be', 'request_id': 'req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:51.432903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] The token cache is being invalidate because project bb4c33274e584df8a977aaf5c4add4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:22:51.433248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:51.433869 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7f3ae347-f7a8-4fa2-97da-f2a4c28b9ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:22:51.435417 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1190/2389] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:22:51 2022] DELETE /identity/v3/projects/bb4c33274e584df8a977aaf5c4add4be => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:22:51.440504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.440504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.441183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.459482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:22:51.460725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:51.521338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1200/2390] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:22:51.528754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.529259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.529487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.548472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:22:51.549857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:51.557673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1191/2391] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:22:51.562709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:51.571744 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2c9e4-1e95-4b62-97bc-bf1aeec3e0e1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:51.576323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:51.576997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.577273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.577544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.578258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:22:51.578555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:51.580147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:51.592578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1201/2392] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:22:51.598016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:51.607561 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4438a22-e1bc-4c51-9113-6f77114dfdd7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:51.612307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:51.613558 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.613837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.614107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.614788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:51.616673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:51.743395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1192/2393] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:22:51 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:22:51.747508 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:51.758094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623e7fb-6137-46e7-b05d-df7cef70d3d1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:51.772027 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:22:51.819715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:51.820401 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.820688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.820999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.821691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:51.823624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:51.936891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1202/2394] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:22:51 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:22:51.941666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:51.952335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03200283-e309-4b03-a071-7e99e78fc3c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:51.958300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:51.958974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:51.959260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:51.959536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:51.960267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:51.961897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:51.973371 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1193/2395] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:22:51.980077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:51.997569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e02ad-0154-4a0f-bb83-a2b6be8e3a48 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:52.008678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827e6cb-26eb-4e8d-b0fc-5b71ae4d8961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:52.008678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e6cb-26eb-4e8d-b0fc-5b71ae4d8961 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:52.008678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e6cb-26eb-4e8d-b0fc-5b71ae4d8961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:52.008678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827e6cb-26eb-4e8d-b0fc-5b71ae4d8961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:52.009165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827e6cb-26eb-4e8d-b0fc-5b71ae4d8961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:52.009165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827e6cb-26eb-4e8d-b0fc-5b71ae4d8961 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:52.020551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1203/2396] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:22:52.025055 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:52.036724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efde2e-9167-4860-b0cd-36b26d181438 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:52.043897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:52.043897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:52.043897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:52.043897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] PATH_INFO: `/v3/projects/0475f252e4da46168fcf72d8cd7ca32a/users/98a64175c84847f48d5b7ca16ed318e4/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:52.059280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0475f252e4da46168fcf72d8cd7ca32a, user_id=98a64175c84847f48d5b7ca16ed318e4, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:52.061999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:52.149507 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1194/2397] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:22:52 2022] PUT /identity/v3/projects/0475f252e4da46168fcf72d8cd7ca32a/users/98a64175c84847f48d5b7ca16ed318e4/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:22:52.160397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:52.160720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:52.161031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:52.187813 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] MFA Rules not processed for user `98a64175c84847f48d5b7ca16ed318e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:22:52.189068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:52.269669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1204/2398] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:22:52.282671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:52.288096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:52.348418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94177e72-97f7-4270-894d-c83a5b92133d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:52.352156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:52.352849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:52.353129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:52.353400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:52.363589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:52.365059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:52.373978 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1195/2399] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:22:53.780806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:53.782189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:53.839007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb07a3d-27db-422f-8a22-6d2dae019401 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:53.842567 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:53.843203 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:53.843482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:53.843800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:53.845574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:53.885160 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:22:53.917582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:53.919276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:53.931423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1205/2400] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:22:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:22:58.389009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:58.390538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:58.409320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d24a1-7018-47f2-b9e2-87d255b681c2 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:58.416893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:58.417577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:58.417857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:58.418131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:58.420752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:58.469780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:22:58.483508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:58.485131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dc586-b8ce-453e-a21c-229eafc43e6e service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:58.495585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1196/2401] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:22:59.112595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:22:59.125399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c266d-0e5b-4722-a64b-6ce55c35f966 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:22:59.131493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:22:59.133598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:22:59.133598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:22:59.133598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:22:59.134618 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:22:59.148513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:22:59.150166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:22:59.164249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1206/2402] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:08.650285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:09.158466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=22 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:13.511941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:13.512444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:13.512617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:13.536036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] MFA Rules not processed for user `4b79ded3ff9146948803b1e63994a225`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:13.536612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:13.553070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:13.615332 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1197/2403] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:13.669246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f431-69fc-4917-82b2-f73deb4d7fc8 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:13.677688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:13.678964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:13.679388 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:13.679775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] PATH_INFO: `/v3/users/98a64175c84847f48d5b7ca16ed318e4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:13.685895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a64175c84847f48d5b7ca16ed318e4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:13.689296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:13.947314 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a64175c84847f48d5b7ca16ed318e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:14.017433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a64175c84847f48d5b7ca16ed318e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:14.019916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a64175c84847f48d5b7ca16ed318e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:14.046344 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a64175c84847f48d5b7ca16ed318e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:14.047489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7a98b80e-638b-40b1-873a-96c744e2b682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a64175c84847f48d5b7ca16ed318e4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:14.071367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:14.093391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9c38b-f312-45ab-9734-171abb2ad73a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:14.125836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:14.125836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:14.125836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:14.125836 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:14.130313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:14.131210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1207/2404] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:23:13 2022] DELETE /identity/v3/users/98a64175c84847f48d5b7ca16ed318e4 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:23:14.131210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:14.131210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:14.131210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:14.136596 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:14.141401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:14.162208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1198/2405] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:14.162632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:14.163885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:14.258212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1208/2406] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:23:14.277715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:14.280285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:14.298405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712d157-55fb-4243-8334-9768dfe32a98 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:14.382122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:14.382791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:14.383068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:14.383348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:14.394780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:14.396265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:14.407994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1199/2407] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:14.976884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:14.979946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:15.030855 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982dd9f-657d-49ca-bf54-2af83cf63202 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:15.039839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:15.043745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.043745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.043745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] PATH_INFO: `/v3/projects/0475f252e4da46168fcf72d8cd7ca32a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.043745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0475f252e4da46168fcf72d8cd7ca32a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:15.045557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:15.066268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:15.214868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:15.217277 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:15.232973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0475f252e4da46168fcf72d8cd7ca32a', 'request_id': 'req-2d6fcc89-af63-4ab7-9376-fd3812a406f0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:15.296964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0475f252e4da46168fcf72d8cd7ca32a', 'request_id': 'req-2d6fcc89-af63-4ab7-9376-fd3812a406f0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:15.304522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0475f252e4da46168fcf72d8cd7ca32a', 'request_id': 'req-2d6fcc89-af63-4ab7-9376-fd3812a406f0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:15.320943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] The token cache is being invalidate because project 0475f252e4da46168fcf72d8cd7ca32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:23:15.321422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:15.322515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2d6fcc89-af63-4ab7-9376-fd3812a406f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:15.324640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1209/2408] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:23:14 2022] DELETE /identity/v3/projects/0475f252e4da46168fcf72d8cd7ca32a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:23:15.331809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c8caf-c2f0-4ccb-a758-8aa53c74ea2d service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:15.333797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8f5b8-db3c-431d-801d-2dc0856c1494 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.334162 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8f5b8-db3c-431d-801d-2dc0856c1494 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.334573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8f5b8-db3c-431d-801d-2dc0856c1494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.354075 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-aec8f5b8-db3c-431d-801d-2dc0856c1494 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:15.355632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aec8f5b8-db3c-431d-801d-2dc0856c1494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:15.384865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:15.411909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:15.412569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.412891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.413172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.415891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:15.421609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1210/2409] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:23:15.429525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:15.430087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.430380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.430668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.431872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:15.446166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1200/2410] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:15.450468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:15.451688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:15.460732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1211/2411] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:23:15.465146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:15.476194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c8330-3758-48b4-ae9c-af02b684c5c5 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:15.481362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:15.482116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.482401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.482679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.483457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:23:15.483757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:15.485424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:15.504827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1201/2412] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:23:15.508236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:15.521366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb517-56b9-477e-b358-ecf8494dd34e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:15.528697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:15.530210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.533758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.534847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.537005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:15.539081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:15.716588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1212/2413] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:23:15 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:23:15.723348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:15.733866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55694b64-7844-4daa-bc36-79007808570d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:15.829891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:15.831162 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.831497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.831723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.832427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:15.838263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:15.937067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1202/2414] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:23:15 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:23:15.941836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:15.952812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c4935-b4bd-4b54-95e0-cade2f18560f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:15.958266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:15.959084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:15.959364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:15.959674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:15.960412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:15.962119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:15.976131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1213/2415] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:23:15.987791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:16.009672 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208392-0526-46f1-aa1e-53387415d3fd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:16.012172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa9846-e6b7-4c61-8d51-d20fde0c5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:16.012912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9846-e6b7-4c61-8d51-d20fde0c5f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:16.013195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9846-e6b7-4c61-8d51-d20fde0c5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:16.013638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9846-e6b7-4c61-8d51-d20fde0c5f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:16.014396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa9846-e6b7-4c61-8d51-d20fde0c5f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:16.016060 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa9846-e6b7-4c61-8d51-d20fde0c5f1b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:16.030854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1203/2416] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:23:16.041320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:16.056871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a1da-3ebf-4672-8222-d20132c3dc67 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:16.065624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:16.068586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:16.068586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:16.068586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] PATH_INFO: `/v3/projects/6cfc138e921941c89c821727bc1a0a84/users/8ea97048af954a1fa0d6a3b114b43b38/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:16.096995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfc138e921941c89c821727bc1a0a84, user_id=8ea97048af954a1fa0d6a3b114b43b38, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:16.100148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:16.213082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1214/2417] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:23:16 2022] PUT /identity/v3/projects/6cfc138e921941c89c821727bc1a0a84/users/8ea97048af954a1fa0d6a3b114b43b38/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:23:16.218418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff53e-dbb6-4221-96ef-cc52939b6c46 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:16.219045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff53e-dbb6-4221-96ef-cc52939b6c46 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:16.219045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cff53e-dbb6-4221-96ef-cc52939b6c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:16.258217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-56cff53e-dbb6-4221-96ef-cc52939b6c46 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:16.258217 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56cff53e-dbb6-4221-96ef-cc52939b6c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:16.335285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1204/2418] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:16.350046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:16.352039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:16.417076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:16.432604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75e49-16ab-4dfb-970a-d5e66113c6dc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:16.436706 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:16.437432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:16.437719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:16.438002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:16.452544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:16.453883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:16.470757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1215/2419] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:18.334886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:18.335362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:18.335472 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:18.355782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] MFA Rules not processed for user `de598ab017c64fd6b99c0ebcfa8d1b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:18.357058 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:18.390621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:18.420818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1205/2420] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:18.974789 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:18.985356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a620-bf77-4ec1-a2a3-bbb724688a05 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:18.994903 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:18.995695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:18.995851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:18.996038 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:18.998173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:19.013415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:19.014877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:19.026320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1216/2421] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:19.875441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:19.879908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:19.932393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b878-6dfe-4f4a-be04-fabea7181e0d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:19.946370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:19.953999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:19.954769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:19.955057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:19.955339 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:19.957810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:19.970498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8b89-80ab-4fad-a9cc-15403be01772 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:19.975884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:19.977594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4179b44-4c90-4ff2-9cdc-fac5c041e63b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:19.978327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:19.979956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:19.981645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:19.982206 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:19.991246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1206/2422] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:20.026685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:20.072959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:20.075391 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:20.102517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1217/2423] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:26.100313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:26.101248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:26.101528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:26.187725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] MFA Rules not processed for user `8ea97048af954a1fa0d6a3b114b43b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:26.189603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:26.386867 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1207/2424] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:26.388702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:26.411112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f8824-c968-44f3-afaa-39670a60351a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:26.423288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:26.425427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:26.428208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:26.428581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:26.429363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:26.432129 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:26.580539 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1218/2425] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:23:26 2022] POST /identity/v3/projects => generated 383 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:23:26.585080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:26.598298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a8cf5-db97-4a72-8483-7a899d9afa83 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:26.712521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:26.713239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:26.713727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:26.714700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:26.715669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:26.726433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:26.832643 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1208/2426] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:23:26 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:23:26.837549 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:26.859482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709d8e-30c5-4026-963d-036a24ba27ca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:26.869148 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:26.870138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:26.870835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:26.871254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:26.872406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:26.874304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:26.898017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:26.898379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1219/2427] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:23:26.914040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59966d2-3f46-4c8c-88cf-450041193d99 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:26.931426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:26.932349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:26.932634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:26.932945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] PATH_INFO: `/v3/projects/4123107639734a758094c7b9d2f2550f/users/8cbd1fe5fdc248d2ab6a812295a44140/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:26.957352 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4123107639734a758094c7b9d2f2550f, user_id=8cbd1fe5fdc248d2ab6a812295a44140, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:26.961456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:27.042659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1209/2428] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:23:26 2022] PUT /identity/v3/projects/4123107639734a758094c7b9d2f2550f/users/8cbd1fe5fdc248d2ab6a812295a44140/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:23:27.046741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:27.059746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a1802-523a-42bb-86ac-f940c6c3bbad admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:27.160758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:27.162371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:27.162723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:27.163002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:27.163833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:27.165647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:27.185342 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1220/2429] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:23:27.186136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:27.202937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c881641-51af-430d-92e6-5be6e2d0e36a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:27.218818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:27.220243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:27.221030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:27.221724 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] PATH_INFO: `/v3/projects/4123107639734a758094c7b9d2f2550f/users/8cbd1fe5fdc248d2ab6a812295a44140/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:27.224767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4123107639734a758094c7b9d2f2550f, user_id=8cbd1fe5fdc248d2ab6a812295a44140, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:27.228077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:27.259996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1210/2430] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:23:27 2022] PUT /identity/v3/projects/4123107639734a758094c7b9d2f2550f/users/8cbd1fe5fdc248d2ab6a812295a44140/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:23:28.781366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:28.784261 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:28.799259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1f65-d462-4803-98b9-8e7554bd6997 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:28.882737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:28.884040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:28.884493 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:28.885177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] PATH_INFO: `/v3/users/5c77b5c6be6b416da83b907f2bb098ab` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:28.887042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c77b5c6be6b416da83b907f2bb098ab)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:28.890156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:28.921299 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:29.137547 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c77b5c6be6b416da83b907f2bb098ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.216140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c77b5c6be6b416da83b907f2bb098ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.217107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c77b5c6be6b416da83b907f2bb098ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.226412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c77b5c6be6b416da83b907f2bb098ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.227595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-55686d35-f517-47a6-a98b-6bb40e2186d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c77b5c6be6b416da83b907f2bb098ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.251025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1221/2431] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:23:28 2022] DELETE /identity/v3/users/5c77b5c6be6b416da83b907f2bb098ab => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:23:29.598880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:29.601454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:29.628475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89e9b-08b8-40ca-90d8-2dfcaede705f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:29.636488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:29.789346 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:29.790404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:29.790785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:29.791158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] PATH_INFO: `/v3/projects/bf92bdbff72f450ebfcb2d68f14aa523` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:29.792501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf92bdbff72f450ebfcb2d68f14aa523)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:29.794610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:29.944312 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf92bdbff72f450ebfcb2d68f14aa523', 'request_id': 'req-6514ba0a-0711-4a5c-8184-c2e11007dfe4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.960363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf92bdbff72f450ebfcb2d68f14aa523', 'request_id': 'req-6514ba0a-0711-4a5c-8184-c2e11007dfe4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:29.971099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf92bdbff72f450ebfcb2d68f14aa523', 'request_id': 'req-6514ba0a-0711-4a5c-8184-c2e11007dfe4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:30.041074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] The token cache is being invalidate because project bf92bdbff72f450ebfcb2d68f14aa523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:23:30.041392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:30.043562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6514ba0a-0711-4a5c-8184-c2e11007dfe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:23:30.046640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1211/2432] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:23:29 2022] DELETE /identity/v3/projects/bf92bdbff72f450ebfcb2d68f14aa523 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:23:30.052749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.053596 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.054034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.091126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:30.096593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:30.259271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1222/2433] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:30.261979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.262316 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.262602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.306832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:30.308093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:30.339780 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1212/2434] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:30.345220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:30.357319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d996386-a0b9-4e63-a4b9-612761b632b6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:30.364135 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:30.365100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.365655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.366100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.367168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:23:30.367627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:30.369529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:30.387541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1223/2435] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:23:30.389272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:30.411805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6d30c-bfba-460b-aa2f-9981b8b66ea7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:30.428971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:30.430172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.433754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.433754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.433754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:30.433754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:30.553388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1213/2436] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:23:30 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:23:30.554689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:30.566310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cbb66-14fd-4bd0-940a-f2e4fbfb69d3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:30.691571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:30.703793 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.704079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.705259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.706268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:30.708673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:30.812592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1224/2437] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:23:30 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:23:30.813389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:30.846884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8f865-3165-435d-b139-3b67b8e1c63c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:30.865565 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:30.867005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.867439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.868082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.868959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:30.870765 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:30.913883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:30.929519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1214/2438] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:23:30.951693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134039c-b1d7-4acd-8007-e1c573feb1a9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:30.959955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab669b-fc31-40d4-8d67-16f2cc23c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:30.961079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab669b-fc31-40d4-8d67-16f2cc23c7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:30.961515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab669b-fc31-40d4-8d67-16f2cc23c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:30.962067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab669b-fc31-40d4-8d67-16f2cc23c7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:30.967168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab669b-fc31-40d4-8d67-16f2cc23c7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:30.968485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab669b-fc31-40d4-8d67-16f2cc23c7b6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:30.994636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1225/2439] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:23:31.001589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:31.011357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bab2-c95a-4a7e-a701-e3c48e1042f6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:31.017493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:31.019824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:31.020078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:31.020919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] PATH_INFO: `/v3/projects/1bf771dcc9ca4e00914c6791c30e3b6e/users/acb62f60a71c441e92f4af065df81d4b/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:31.064539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf771dcc9ca4e00914c6791c30e3b6e, user_id=acb62f60a71c441e92f4af065df81d4b, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:31.067516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:31.183717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1215/2440] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:23:30 2022] PUT /identity/v3/projects/1bf771dcc9ca4e00914c6791c30e3b6e/users/acb62f60a71c441e92f4af065df81d4b/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:23:31.184410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e1d86-ffd6-4734-9d61-bb13459ea306 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:31.184878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e1d86-ffd6-4734-9d61-bb13459ea306 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:31.184960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e1d86-ffd6-4734-9d61-bb13459ea306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:31.198421 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:31.214895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-981e1d86-ffd6-4734-9d61-bb13459ea306 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:31.216373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-981e1d86-ffd6-4734-9d61-bb13459ea306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:31.374691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1226/2441] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:31.403555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:31.406922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:31.553314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:31.603851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99750a-11c4-4f58-98d1-7e4c110890d3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:31.608925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:31.609688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:31.613770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:31.613770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:31.631632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:31.633320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:31.652387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1216/2442] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:32.326808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:32.327322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:32.327322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:32.352971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:32.354236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:32.450572 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1227/2443] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:32.670906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:32.672576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:32.808350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6998-9f82-4ca2-884b-c7b828f6cf90 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:32.816932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7d1a-b860-4817-9381-7d77d40c5585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:32.818379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7d1a-b860-4817-9381-7d77d40c5585 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:32.818723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7d1a-b860-4817-9381-7d77d40c5585 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:32.819175 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7d1a-b860-4817-9381-7d77d40c5585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:32.829825 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7d1a-b860-4817-9381-7d77d40c5585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:32.832276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7d1a-b860-4817-9381-7d77d40c5585 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:32.841664 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1217/2444] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:23:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:23:35.375558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:35.378642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:35.492019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf659e-9625-4a01-bc25-0c6b022c57a9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:35.506517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:35.507577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:35.510159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:35.510621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:35.515559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:35.554861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:35.559871 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:35.584952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1228/2445] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:37.228982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb87df-e284-4c4e-b9d5-62b9a885cfc4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:37.230061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb87df-e284-4c4e-b9d5-62b9a885cfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:37.230553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb87df-e284-4c4e-b9d5-62b9a885cfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:37.284641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1eeb87df-e284-4c4e-b9d5-62b9a885cfc4 None None] MFA Rules not processed for user `8cbd1fe5fdc248d2ab6a812295a44140`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:37.290260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1eeb87df-e284-4c4e-b9d5-62b9a885cfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:37.461220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1218/2446] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:37.477042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:37.482373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:37.660199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:23:37.739592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1adbd4-c44c-4594-b5d8-1dc8cb2e12d2 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:37.749760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:37.758037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:37.758757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:37.759257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:37.765617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:37.902120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:37.904967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:37.927188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1229/2447] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:38.376415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:38.377286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:38.377286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:38.436441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:38.446946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:38.492640 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1219/2448] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:23:38.519829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:38.553165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088bd8-00b7-4015-b27c-40fac86ab42e service glance] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:38.564259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e6f6b-9629-448c-af82-8696948542ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:38.569225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6f6b-9629-448c-af82-8696948542ed service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:38.569225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6f6b-9629-448c-af82-8696948542ed service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:38.569225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e6f6b-9629-448c-af82-8696948542ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:38.578304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6f6b-9629-448c-af82-8696948542ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:38.581492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e6f6b-9629-448c-af82-8696948542ed service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:38.593003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1230/2449] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 14:23:45.231835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:45.234143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:45.273525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ce39-9db1-4c98-97d3-012dfda8660c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:45.280311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:45.281244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:45.281757 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:45.282822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:45.290091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:45.322651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:45.324541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:45.359516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1220/2450] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:48.513557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029898d-2ca4-46fa-9e51-dd6ecc886b11 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:48.513557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029898d-2ca4-46fa-9e51-dd6ecc886b11 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:48.513557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029898d-2ca4-46fa-9e51-dd6ecc886b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:48.603000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0029898d-2ca4-46fa-9e51-dd6ecc886b11 None None] MFA Rules not processed for user `acb62f60a71c441e92f4af065df81d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:48.606252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0029898d-2ca4-46fa-9e51-dd6ecc886b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:48.889934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1231/2451] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:48.907843 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:23:48.931254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866d8c-733f-4aeb-9154-8486ab52c6ea service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:23:48.945948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0140-e16f-4de9-8bc5-1359b9604f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:23:48.949191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0140-e16f-4de9-8bc5-1359b9604f2c service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:48.950977 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0140-e16f-4de9-8bc5-1359b9604f2c service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:48.952057 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0140-e16f-4de9-8bc5-1359b9604f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:48.980928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c0140-e16f-4de9-8bc5-1359b9604f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:23:48.985754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c0140-e16f-4de9-8bc5-1359b9604f2c service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:23:49.013523 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1221/2452] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:23:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:23:55.971816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16d80-f460-434d-9931-eb7a80c5157c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:55.972726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16d80-f460-434d-9931-eb7a80c5157c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:55.972726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d16d80-f460-434d-9931-eb7a80c5157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:55.998797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-53d16d80-f460-434d-9931-eb7a80c5157c None None] MFA Rules not processed for user `acb62f60a71c441e92f4af065df81d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:56.000342 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-53d16d80-f460-434d-9931-eb7a80c5157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:56.011333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1232/2453] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:23:57.994856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:23:57.996410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:23:57.997130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:23:58.027033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] MFA Rules not processed for user `8ea97048af954a1fa0d6a3b114b43b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:23:58.029286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:23:58.052895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1222/2454] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:23:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:24:02.407057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69289-b719-41dd-8a13-06e0755e0725 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:02.407057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69289-b719-41dd-8a13-06e0755e0725 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:02.408073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b69289-b719-41dd-8a13-06e0755e0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:02.435133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a0b69289-b719-41dd-8a13-06e0755e0725 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:24:02.436521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a0b69289-b719-41dd-8a13-06e0755e0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:24:02.444527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1233/2455] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:24:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:24:02.459903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:24:02.475779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15c376-fcbb-46e5-bb46-660d53e86b60 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:24:02.481261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:24:02.482166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:02.482464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:02.482730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:02.492387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:24:02.494122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:24:02.498071 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:02.504216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1223/2456] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:24:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:24:12.428006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=76 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:12.603456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:16.360002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:16.360557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:16.360557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:16.379805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:24:16.381062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:24:16.389047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1234/2457] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:24:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:24:16.407306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:24:16.418033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703545fb-1983-48a7-84db-e99f5384c88f service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:24:16.423531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2760e1-b110-4da9-a77c-159d86621652 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:24:16.424187 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2760e1-b110-4da9-a77c-159d86621652 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:16.424468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2760e1-b110-4da9-a77c-159d86621652 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:16.424768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2760e1-b110-4da9-a77c-159d86621652 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:16.434095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2760e1-b110-4da9-a77c-159d86621652 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:24:16.435682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2760e1-b110-4da9-a77c-159d86621652 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:24:16.445324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1224/2458] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:24:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:24:20.972967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:24:20.988363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666638a3-d816-4f1b-b142-5a6af2134d1c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:24:20.994420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:24:20.995119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:20.995398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:20.995695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:20.998331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:24:21.092612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:24:21.095180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:24:21.111020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1235/2459] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:24:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:24:26.441428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:31.101583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=31 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:33.017968 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:33.018512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:33.018512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:33.037053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:24:33.038269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:24:33.045677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1225/2460] 10.222.0.71 () {58 vars in 967 bytes} [Wed May 18 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:24:33.069517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:24:33.081872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf488-995e-452c-b7ad-c1911507de3d service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:24:33.086962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:24:33.087646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:33.087923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:33.088640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:33.097805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:24:33.106929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:24:33.108088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1236/2461] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:24:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:24:43.031340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:43.040207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:24:43.043292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:24:43.053627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15846653-cc10-4bf0-9f59-a5492e57c028 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:24:43.057592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:24:43.058358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:24:43.058644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:24:43.058976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:24:43.071691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:24:43.074553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:24:43.093592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1226/2462] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:24:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:24:43.104504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:24:53.084741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:05.466175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:05.476920 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ed9b-7be7-4bb3-8120-a612c775af6e service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:05.482297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:05.483393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:05.483910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:05.484415 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:05.486748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:05.504693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:05.506225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:05.516501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1237/2463] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:09.418073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:09.419591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:09.434758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352221e-88dc-43f5-8b02-3290d576a850 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:09.439358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:09.443538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:09.443538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:09.443538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] PATH_INFO: `/v3/users/de598ab017c64fd6b99c0ebcfa8d1b64` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:09.443538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de598ab017c64fd6b99c0ebcfa8d1b64)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:09.444916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:09.588604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de598ab017c64fd6b99c0ebcfa8d1b64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:09.589236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de598ab017c64fd6b99c0ebcfa8d1b64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:09.589874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de598ab017c64fd6b99c0ebcfa8d1b64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:09.642727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de598ab017c64fd6b99c0ebcfa8d1b64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:09.658699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-56190cba-c869-418e-be7d-7b0451bf51e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de598ab017c64fd6b99c0ebcfa8d1b64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:09.672299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1227/2464] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:09 2022] DELETE /identity/v3/users/de598ab017c64fd6b99c0ebcfa8d1b64 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:09.941747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:09.955624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50bcf-77de-4147-a1e4-ba7b488dad76 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.020423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.022004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.022286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.022557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] PATH_INFO: `/v3/projects/658446fc889449e6bc55b5856b9ce144` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.023796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658446fc889449e6bc55b5856b9ce144)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.025765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:10.173445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658446fc889449e6bc55b5856b9ce144', 'request_id': 'req-3180fc39-3a96-489b-bfe2-64e630d1a9f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:10.248627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658446fc889449e6bc55b5856b9ce144', 'request_id': 'req-3180fc39-3a96-489b-bfe2-64e630d1a9f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:10.256284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658446fc889449e6bc55b5856b9ce144', 'request_id': 'req-3180fc39-3a96-489b-bfe2-64e630d1a9f8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:10.267720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] The token cache is being invalidate because project 658446fc889449e6bc55b5856b9ce144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:10.268009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:10.268675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3180fc39-3a96-489b-bfe2-64e630d1a9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:10.271822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1238/2465] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:09 2022] DELETE /identity/v3/projects/658446fc889449e6bc55b5856b9ce144 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:10.277247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.278819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.278819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.300999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:10.302252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:10.387498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1228/2466] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:10.397434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.397801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.398229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.429262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:10.431134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:10.441801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1239/2467] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:10.447333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:10.457405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c411ba5-53ea-4016-be86-a248b40f6bdf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.462444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.463105 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.463389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.463758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.464401 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:10.464705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.466359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:10.478923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1229/2468] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:25:10.483215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:10.493320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17200be-d801-4e53-a692-269a51c1ddf9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.498068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.498742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.499024 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.499298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.499984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.501938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:10.605181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1240/2469] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:10 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:10.609863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:10.622861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7317775-5057-4f8e-824d-02d734a4ef6c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.686466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.687136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.687420 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.687695 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.688392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.690367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:10.698197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:10.797337 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1230/2470] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:10 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:10.801210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:10.812362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0204-f9e5-482b-a8dd-b6603b0f6256 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.818609 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.819297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.819576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.819850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.820581 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.822284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:10.832846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1241/2471] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:10.839576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:10.850065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbf9c9-93bc-4929-983a-c03ad48c31f1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.854747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40e932-cab7-4f63-8153-3726e7cbd531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.855412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e932-cab7-4f63-8153-3726e7cbd531 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.855697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e932-cab7-4f63-8153-3726e7cbd531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.855973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40e932-cab7-4f63-8153-3726e7cbd531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.856697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40e932-cab7-4f63-8153-3726e7cbd531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.858407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40e932-cab7-4f63-8153-3726e7cbd531 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:10.869229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1231/2472] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:10.873502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:10.883964 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28647122-95d2-4e2f-bdac-94928110219d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:10.888591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:10.889512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:10.889797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:10.890078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] PATH_INFO: `/v3/projects/8df6e7aec8244e70bb3194ba6528f7cc/users/83f0f3a516f74e7b85550e2449972ed6/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:10.906090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df6e7aec8244e70bb3194ba6528f7cc, user_id=83f0f3a516f74e7b85550e2449972ed6, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:10.908748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.003507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1242/2473] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:10 2022] PUT /identity/v3/projects/8df6e7aec8244e70bb3194ba6528f7cc/users/83f0f3a516f74e7b85550e2449972ed6/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:11.014673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.014948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.015210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.044021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] MFA Rules not processed for user `83f0f3a516f74e7b85550e2449972ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:11.045292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:11.117279 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1232/2474] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:11.121931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.128239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:11.191018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcbb9e-d18a-4014-ba05-f0a4ea17ea58 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:11.196631 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:11.197352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.197633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.197922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.198667 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:11.200534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.312830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1243/2475] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:11 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:11.317042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.329253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abfe1c-e372-4001-8bba-99e04a5c50ef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:11.389726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:11.390313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.390593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.390874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.391571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:11.393597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.500252 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1233/2476] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:11 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:11.504535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.515009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986abea-1b49-40d3-99f0-0f423439c03c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:11.519592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:11.520254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.520532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.520825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.521767 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:11.523410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.535179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1244/2477] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:11.541167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.557347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d7d84-71ab-4910-90f4-d943c811465c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:11.564145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:11.565065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.565343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.565611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] PATH_INFO: `/v3/projects/0e5ddec316e94cb0845f53bac6ea971f/users/e3abe61ac3ab4e0cba6c72e8653052e7/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.581311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5ddec316e94cb0845f53bac6ea971f, user_id=e3abe61ac3ab4e0cba6c72e8653052e7, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:11.584328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.655024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1234/2478] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:11 2022] PUT /identity/v3/projects/0e5ddec316e94cb0845f53bac6ea971f/users/e3abe61ac3ab4e0cba6c72e8653052e7/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:11.661230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.670696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474beca-d662-4c95-87e0-10f96691cb3e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:11.730712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b30809-776f-4cee-91f1-3379571d65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:11.731379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30809-776f-4cee-91f1-3379571d65af admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.731658 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30809-776f-4cee-91f1-3379571d65af admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.731931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b30809-776f-4cee-91f1-3379571d65af admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.732690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30809-776f-4cee-91f1-3379571d65af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:11.734340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b30809-776f-4cee-91f1-3379571d65af admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.745786 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1245/2479] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:11.756898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.767517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f1f4-024e-4c9e-b061-1c82518e0776 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:11.772878 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:11.773841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.774163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.774486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] PATH_INFO: `/v3/projects/0e5ddec316e94cb0845f53bac6ea971f/users/e3abe61ac3ab4e0cba6c72e8653052e7/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.776624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5ddec316e94cb0845f53bac6ea971f, user_id=e3abe61ac3ab4e0cba6c72e8653052e7, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:11.779707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:11.791366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1235/2480] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:11 2022] PUT /identity/v3/projects/0e5ddec316e94cb0845f53bac6ea971f/users/e3abe61ac3ab4e0cba6c72e8653052e7/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:11.801647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:11.802015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:11.803636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:11.836366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] MFA Rules not processed for user `e3abe61ac3ab4e0cba6c72e8653052e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:11.837742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:11.914876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:11.919028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1246/2481] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:11.930950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:11.932627 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:11.959668 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:12.011810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9831b-c93f-4923-8f9c-db46c89ae897 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:12.024521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1942ab-8138-4e8e-a933-24ab27e5568d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:12.025110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1942ab-8138-4e8e-a933-24ab27e5568d service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:12.025388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1942ab-8138-4e8e-a933-24ab27e5568d service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:12.025871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1942ab-8138-4e8e-a933-24ab27e5568d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:12.037577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1942ab-8138-4e8e-a933-24ab27e5568d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:12.039177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1942ab-8138-4e8e-a933-24ab27e5568d service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:12.054323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1236/2482] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:13.119243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:13.199690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158018ee-9717-4150-9e18-391cdbceed3f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:13.204857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:13.205755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:13.206037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:13.206315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] PATH_INFO: `/v3/users/83f0f3a516f74e7b85550e2449972ed6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:13.207525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f0f3a516f74e7b85550e2449972ed6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:13.210282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:13.457051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f0f3a516f74e7b85550e2449972ed6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:13.528699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f0f3a516f74e7b85550e2449972ed6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:13.529356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f0f3a516f74e7b85550e2449972ed6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:13.538797 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f0f3a516f74e7b85550e2449972ed6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:13.539535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f0f3a516f74e7b85550e2449972ed6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:13.563587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1247/2483] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:13 2022] DELETE /identity/v3/users/83f0f3a516f74e7b85550e2449972ed6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:13.569219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:13.569219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:13.570022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:13.587734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:13.589011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:13.652315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1237/2484] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:13.662933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:13.664380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:13.727273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74972e-903b-4906-89cc-66a9e8038554 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:13.730910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:13.731562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:13.731844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:13.732540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:13.741852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:13.743285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:13.753355 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1248/2485] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:14.158501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:14.159940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:14.180557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ae3b1-28cd-4f53-adbe-fd3271a84df6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:14.187908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:14.188842 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:14.189153 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:14.189609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] PATH_INFO: `/v3/projects/8df6e7aec8244e70bb3194ba6528f7cc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:14.190720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df6e7aec8244e70bb3194ba6528f7cc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:14.192648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:14.312573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df6e7aec8244e70bb3194ba6528f7cc', 'request_id': 'req-78f44d6a-98d7-4441-8a68-e5bef41901c7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.320297 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df6e7aec8244e70bb3194ba6528f7cc', 'request_id': 'req-78f44d6a-98d7-4441-8a68-e5bef41901c7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.328905 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df6e7aec8244e70bb3194ba6528f7cc', 'request_id': 'req-78f44d6a-98d7-4441-8a68-e5bef41901c7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.428081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] The token cache is being invalidate because project 8df6e7aec8244e70bb3194ba6528f7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:14.428229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.429792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.432820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1238/2486] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:14 2022] DELETE /identity/v3/projects/8df6e7aec8244e70bb3194ba6528f7cc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:14.440811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:14.450890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873a5ae-fa7c-490b-a046-98838fbb9231 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:14.471100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:14.522551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:14.524070 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:14.524556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:14.525097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] PATH_INFO: `/v3/users/e3abe61ac3ab4e0cba6c72e8653052e7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:14.527531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3abe61ac3ab4e0cba6c72e8653052e7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:14.530712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:14.744018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3abe61ac3ab4e0cba6c72e8653052e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.831593 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3abe61ac3ab4e0cba6c72e8653052e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.833205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3abe61ac3ab4e0cba6c72e8653052e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.842627 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3abe61ac3ab4e0cba6c72e8653052e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.843395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14a1e2d7-7818-4219-bb7f-a702e65fd102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3abe61ac3ab4e0cba6c72e8653052e7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:14.862879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1249/2487] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:14 2022] DELETE /identity/v3/users/e3abe61ac3ab4e0cba6c72e8653052e7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:15.350284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:15.351862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:15.365345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f44d6a-98d7-4441-8a68-e5bef41901c7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:15.423594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:15.438264 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:15.447223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:15.447223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:15.447223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] PATH_INFO: `/v3/projects/0e5ddec316e94cb0845f53bac6ea971f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:15.447223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5ddec316e94cb0845f53bac6ea971f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:15.447223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:15.574519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5ddec316e94cb0845f53bac6ea971f', 'request_id': 'req-40c33168-ec73-4c32-a3d6-4be19a2345be'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:15.584569 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5ddec316e94cb0845f53bac6ea971f', 'request_id': 'req-40c33168-ec73-4c32-a3d6-4be19a2345be'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:15.591612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5ddec316e94cb0845f53bac6ea971f', 'request_id': 'req-40c33168-ec73-4c32-a3d6-4be19a2345be'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:15.654670 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] The token cache is being invalidate because project 0e5ddec316e94cb0845f53bac6ea971f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:15.654984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:15.657172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-40c33168-ec73-4c32-a3d6-4be19a2345be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:15.659489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1239/2488] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:15 2022] DELETE /identity/v3/projects/0e5ddec316e94cb0845f53bac6ea971f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:15.665254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:15.666142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:15.666419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:15.686019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:15.687248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:15.750348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1250/2489] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:15.760125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:15.760415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:15.760692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:15.779782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:15.781034 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:15.790054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1240/2490] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:15.794474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:15.806095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9fe19-b4a1-4acf-bc5b-a4ee7718404d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:15.811464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:15.812103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:15.812423 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:15.812699 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:15.813451 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:15.813817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:15.815345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:15.828040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1251/2491] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:25:15.832912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:15.843534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca765-c983-4dbe-b0a7-ffd216c1cf26 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:15.848202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:15.848941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:15.849918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:15.850373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:15.850929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:15.852876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:15.960900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1241/2492] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:15 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:15.965224 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:15.976654 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554f76-7c48-4b20-ad12-84e7f051bc0c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:16.006902 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:16.039372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:16.040034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:16.040328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:16.040610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:16.041338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:16.043285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:16.225734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1252/2493] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:15 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:16.227646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:16.244730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e432a-8291-420a-a6bf-44c4464bf3b0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:16.250552 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:16.251268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:16.251553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:16.251855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:16.252599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:16.254269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:16.274026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1242/2494] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:16.275648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:16.288284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207f9bb-4fe8-4edd-9d22-980f891d9067 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:16.293647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3f9e-df1c-49a4-a21c-deff26b4c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:16.294413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3f9e-df1c-49a4-a21c-deff26b4c67d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:16.294760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3f9e-df1c-49a4-a21c-deff26b4c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:16.295109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3f9e-df1c-49a4-a21c-deff26b4c67d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:16.295909 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3f9e-df1c-49a4-a21c-deff26b4c67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:16.297622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3f9e-df1c-49a4-a21c-deff26b4c67d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:16.312153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1253/2495] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:16.313441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:16.324841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc540c-0894-466e-8015-0bf1959ebb9e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:16.329658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:16.330549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:16.330829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:16.331123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] PATH_INFO: `/v3/projects/57686e76057c411fa59dd773535df9e9/users/bb70130706164634977b564d642853d4/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:16.350062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57686e76057c411fa59dd773535df9e9, user_id=bb70130706164634977b564d642853d4, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:16.352831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:16.574574 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1243/2496] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:16 2022] PUT /identity/v3/projects/57686e76057c411fa59dd773535df9e9/users/bb70130706164634977b564d642853d4/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:16.585998 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:16.586287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:16.586566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:16.615292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] MFA Rules not processed for user `bb70130706164634977b564d642853d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:16.616537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:16.699288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1254/2497] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:16.703619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:16.815663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a311ff-ec0b-4dc6-99e7-21fe42e9ae5e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:16.823533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:16.824513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:16.824907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:16.825890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:16.827041 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:16.829046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:16.912519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:16.921995 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1244/2498] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:16 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:16.933104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:16.948320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62cd18-5547-4676-9a18-a1963980c16a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:17.040928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:17.041691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.042045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.042310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.043013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:17.045049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:17.084872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:17.086959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:17.166505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1255/2499] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:16 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:17.172125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:17.174054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e2647-c7b7-4036-9ad8-8c2712bbc578 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:17.179427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:17.180100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.180562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.180877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.182939 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:17.185656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce30c4-df5e-496b-bf2d-f0c9b849369b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:17.191460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:17.196660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.196660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.196660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.196660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:17.196660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:17.215629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1256/2500] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:25:17.216753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:17.231044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2c79a-a19c-43dd-87d5-85943db2000c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:17.247737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:17.248916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.249225 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.249715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] PATH_INFO: `/v3/projects/27745476ffdb48a29c7f6cb0181bf03a/users/fac34e41a9714412a93aed3b4d8323d0/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.265866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:17.276071 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27745476ffdb48a29c7f6cb0181bf03a, user_id=fac34e41a9714412a93aed3b4d8323d0, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:17.280290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:17.284214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:17.285721 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:17.297734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1245/2501] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:25:17.397480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1257/2502] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:17 2022] PUT /identity/v3/projects/27745476ffdb48a29c7f6cb0181bf03a/users/fac34e41a9714412a93aed3b4d8323d0/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:17.403282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:17.417398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dcb4e-8565-481a-847b-35172b5f6ebc service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:17.503489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc08e4a-4cdf-4301-8f70-2741589fdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:17.504766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08e4a-4cdf-4301-8f70-2741589fdf32 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.505216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08e4a-4cdf-4301-8f70-2741589fdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.505626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc08e4a-4cdf-4301-8f70-2741589fdf32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.506653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc08e4a-4cdf-4301-8f70-2741589fdf32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:17.508499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc08e4a-4cdf-4301-8f70-2741589fdf32 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:17.529223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1246/2503] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:17.531136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:17.548332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd438-17a2-43d8-8109-c91917f9ac8e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:17.557313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:17.559163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.559163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.559163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] PATH_INFO: `/v3/projects/27745476ffdb48a29c7f6cb0181bf03a/users/fac34e41a9714412a93aed3b4d8323d0/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.561325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27745476ffdb48a29c7f6cb0181bf03a, user_id=fac34e41a9714412a93aed3b4d8323d0, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:17.564317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:17.587265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1258/2504] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:17 2022] PUT /identity/v3/projects/27745476ffdb48a29c7f6cb0181bf03a/users/fac34e41a9714412a93aed3b4d8323d0/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:17.589068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:17.589626 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:17.590116 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:17.627118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] MFA Rules not processed for user `fac34e41a9714412a93aed3b4d8323d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:17.643314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:17.812848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1247/2505] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:17.879498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:17.917418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:17.979381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ae125-7d25-49c8-9dda-6066ee0b944b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:18.001946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835cd4b-3bb6-4046-a4a3-11d9b5bfd4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:18.002636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835cd4b-3bb6-4046-a4a3-11d9b5bfd4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:18.002927 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835cd4b-3bb6-4046-a4a3-11d9b5bfd4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:18.003405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835cd4b-3bb6-4046-a4a3-11d9b5bfd4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:18.032149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835cd4b-3bb6-4046-a4a3-11d9b5bfd4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:18.033810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835cd4b-3bb6-4046-a4a3-11d9b5bfd4b7 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:18.061513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1259/2506] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:25:21.894253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:22.010910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d188c-2754-4d0e-a704-d88ee14d339d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:22.018200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:22.019701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:22.019992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:22.020272 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] PATH_INFO: `/v3/users/bb70130706164634977b564d642853d4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:22.021865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb70130706164634977b564d642853d4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:22.024324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:22.218644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb70130706164634977b564d642853d4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:22.219720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb70130706164634977b564d642853d4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:22.220483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb70130706164634977b564d642853d4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:22.289258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb70130706164634977b564d642853d4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:22.307734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb70130706164634977b564d642853d4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:22.330879 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1248/2507] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:21 2022] DELETE /identity/v3/users/bb70130706164634977b564d642853d4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:22.337506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:22.339283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:22.340584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:22.395018 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:22.397280 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:22.514019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1260/2508] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:22.524660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:22.526781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:22.617703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0def-376b-42f5-a895-eb9ed122d971 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:22.622028 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:22.622688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:22.622975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:22.623244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:22.633242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:22.636850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:22.638745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:22.666411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1249/2509] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:23.265785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:23.267918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:23.306519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf7be7-109f-4cb4-a1b2-b7b260c538a9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:23.313142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:23.314888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:23.314888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:23.315219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] PATH_INFO: `/v3/projects/57686e76057c411fa59dd773535df9e9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:23.321259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57686e76057c411fa59dd773535df9e9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:23.321259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:23.541531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57686e76057c411fa59dd773535df9e9', 'request_id': 'req-65b90ba7-b307-4b66-914c-2dca18432e90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:23.619440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57686e76057c411fa59dd773535df9e9', 'request_id': 'req-65b90ba7-b307-4b66-914c-2dca18432e90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:23.625608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57686e76057c411fa59dd773535df9e9', 'request_id': 'req-65b90ba7-b307-4b66-914c-2dca18432e90'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:23.668267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] The token cache is being invalidate because project 57686e76057c411fa59dd773535df9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:23.668267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:23.668267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:23.668267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1261/2510] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:23 2022] DELETE /identity/v3/projects/57686e76057c411fa59dd773535df9e9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:23.669165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:23.672324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5137f2-95dc-4da3-854a-160a7954e4f2 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:23.740539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:23.741454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:23.741749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:23.742048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] PATH_INFO: `/v3/users/fac34e41a9714412a93aed3b4d8323d0` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:23.743408 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac34e41a9714412a93aed3b4d8323d0)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:23.745428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:24.160608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac34e41a9714412a93aed3b4d8323d0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:24.161831 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac34e41a9714412a93aed3b4d8323d0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:24.163054 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac34e41a9714412a93aed3b4d8323d0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:24.246797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac34e41a9714412a93aed3b4d8323d0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:24.260774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8184a75c-47b2-4e86-a491-458b1df44e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac34e41a9714412a93aed3b4d8323d0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:24.275915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1250/2511] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:23 2022] DELETE /identity/v3/users/fac34e41a9714412a93aed3b4d8323d0 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:24.840111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:24.841575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:24.855446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:24.859039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90ba7-b307-4b66-914c-2dca18432e90 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:24.933395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:24.934286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:24.934559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:24.934848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] PATH_INFO: `/v3/projects/27745476ffdb48a29c7f6cb0181bf03a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:24.936210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27745476ffdb48a29c7f6cb0181bf03a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:24.938177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:25.085607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27745476ffdb48a29c7f6cb0181bf03a', 'request_id': 'req-d6d13a7d-9596-4bbe-8656-6d8330542d5d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:25.157345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27745476ffdb48a29c7f6cb0181bf03a', 'request_id': 'req-d6d13a7d-9596-4bbe-8656-6d8330542d5d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:25.166406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27745476ffdb48a29c7f6cb0181bf03a', 'request_id': 'req-d6d13a7d-9596-4bbe-8656-6d8330542d5d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:25.181424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] The token cache is being invalidate because project 27745476ffdb48a29c7f6cb0181bf03a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:25.181876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:25.182712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d6d13a7d-9596-4bbe-8656-6d8330542d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:25.184309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1262/2512] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:24 2022] DELETE /identity/v3/projects/27745476ffdb48a29c7f6cb0181bf03a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:25.189784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.190620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.190784 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.213989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:25.215459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:25.300906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1251/2513] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:25.311374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.312088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.312873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.348626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:25.351404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:25.367221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1263/2514] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:25.372193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:25.389260 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44f44b-6dee-40f3-bd29-ac40f2a68055 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:25.396020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:25.396864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.397155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.397460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.398432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:25.398772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:25.401678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:25.422860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1252/2515] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:25:25.428198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:25.438194 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3a53-0064-41e2-880b-79ad8ce50c1c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:25.443993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:25.444677 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.444996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.445396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.446155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:25.448072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:25.583684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1264/2516] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:25 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:25.588473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:25.594594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:25.601505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9efa7-41ee-4eb9-8cfc-0aad3ea16ddf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:25.678981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:25.679922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.680303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.680745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.681761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:25.688588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:25.808861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1253/2517] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:25 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:25.810290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:25.824990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268448c-05f1-4726-a92e-57826a187c5d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:25.830034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:25.830802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.831083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.831352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.832093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:25.835362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:25.854937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1265/2518] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:25.860764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:25.876683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ad963-259f-499f-938d-03e32d7dbcf7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:25.884763 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d276ce-d4ef-43c4-a6e5-2e8bb2f3ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:25.885474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d276ce-d4ef-43c4-a6e5-2e8bb2f3ba18 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.885762 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d276ce-d4ef-43c4-a6e5-2e8bb2f3ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.886043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d276ce-d4ef-43c4-a6e5-2e8bb2f3ba18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.886812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d276ce-d4ef-43c4-a6e5-2e8bb2f3ba18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:25.889345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d276ce-d4ef-43c4-a6e5-2e8bb2f3ba18 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:25.902179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1254/2519] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:25.907122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:25.922067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ea1e1-5156-470d-b43a-daa54c2c61c1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:25.927949 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:25.929065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:25.929351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:25.929626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] PATH_INFO: `/v3/projects/0d4c5e2193794f7a8d054786c438df2f/users/8d64f0f197d14c07be22903e5f56143b/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:25.949197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4c5e2193794f7a8d054786c438df2f, user_id=8d64f0f197d14c07be22903e5f56143b, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:25.952120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:26.049925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1266/2520] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:25 2022] PUT /identity/v3/projects/0d4c5e2193794f7a8d054786c438df2f/users/8d64f0f197d14c07be22903e5f56143b/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:26.061707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.062042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.062343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.094862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] MFA Rules not processed for user `8d64f0f197d14c07be22903e5f56143b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:26.096238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:26.169991 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1255/2521] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:26.174746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:26.213531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:26.256441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ad15-68d5-43b6-a3d8-253b5d610287 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:26.264163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e002ca-30d1-4e07-8095-6aaebd0165bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:26.264876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e002ca-30d1-4e07-8095-6aaebd0165bb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.265191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e002ca-30d1-4e07-8095-6aaebd0165bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.265424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e002ca-30d1-4e07-8095-6aaebd0165bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.266784 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e002ca-30d1-4e07-8095-6aaebd0165bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:26.268728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e002ca-30d1-4e07-8095-6aaebd0165bb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:26.393332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1267/2522] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:26 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:26.395658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:26.408334 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc39c0-74b8-4cdc-b947-7c743d6060e6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:26.485524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:26.486330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.486655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.486938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.487760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224883-e427-4177-98cc-d271678db6a0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.487994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:26.488102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224883-e427-4177-98cc-d271678db6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.488308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45224883-e427-4177-98cc-d271678db6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.491061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:26.510552 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-45224883-e427-4177-98cc-d271678db6a0 None None] MFA Rules not processed for user `4b79ded3ff9146948803b1e63994a225`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:26.511887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-45224883-e427-4177-98cc-d271678db6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:26.584426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1268/2523] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:26.585755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224883-e427-4177-98cc-d271678db6a0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:26.590741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-45224883-e427-4177-98cc-d271678db6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:26.628886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:26.638492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1256/2524] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:26 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:26.642542 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:26.657861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70e2f6-40a6-4d6b-8529-fb7f22a038e1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:26.665106 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:26.665871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.666193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.666590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.667571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:26.672011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:26.708881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1257/2525] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:25:26.712669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:26.715141 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45224883-e427-4177-98cc-d271678db6a0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:26.719290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:26.720253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.720540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.720846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.723003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:26.724827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca618770-599e-46f1-bcaa-053ef312f886 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:26.730739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:26.731742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.732082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.732434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] PATH_INFO: `/v3/projects/ce90a28c6e844d618e4d1461149b91b2/users/f90228559d79490f96f408f6b216f301/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.737546 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:26.739020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:26.751648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1269/2526] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:26.766526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90a28c6e844d618e4d1461149b91b2, user_id=f90228559d79490f96f408f6b216f301, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:26.769719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:26.873186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1258/2527] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:26 2022] PUT /identity/v3/projects/ce90a28c6e844d618e4d1461149b91b2/users/f90228559d79490f96f408f6b216f301/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:26.874535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:26.889009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61929-cd21-451e-886a-456adca8edd3 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:26.986041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2582c7-007f-4947-a959-9145bacccdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:26.986755 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2582c7-007f-4947-a959-9145bacccdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:26.987046 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2582c7-007f-4947-a959-9145bacccdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:26.987380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2582c7-007f-4947-a959-9145bacccdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:26.988125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2582c7-007f-4947-a959-9145bacccdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:26.990926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2582c7-007f-4947-a959-9145bacccdb8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:27.000713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:27.009816 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1270/2528] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:27.017020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:27.031017 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b43-0638-4584-b9da-c377f333ea9b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:27.037363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:27.038456 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:27.038747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:27.039023 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] PATH_INFO: `/v3/projects/ce90a28c6e844d618e4d1461149b91b2/users/f90228559d79490f96f408f6b216f301/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:27.041213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce90a28c6e844d618e4d1461149b91b2, user_id=f90228559d79490f96f408f6b216f301, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:27.044172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:27.065185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1259/2529] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:27 2022] PUT /identity/v3/projects/ce90a28c6e844d618e4d1461149b91b2/users/f90228559d79490f96f408f6b216f301/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:27.075144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:27.075437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:27.075732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:27.116420 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] MFA Rules not processed for user `f90228559d79490f96f408f6b216f301`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:27.118089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:27.245578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1271/2530] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:27.262781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:27.265121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:27.352002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845a57b-13e7-44f1-885a-6c61ffec479e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:27.356109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79dead-7b2e-491e-8c26-d61024aea0a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:27.356937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79dead-7b2e-491e-8c26-d61024aea0a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:27.357274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79dead-7b2e-491e-8c26-d61024aea0a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:27.357559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79dead-7b2e-491e-8c26-d61024aea0a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:27.370180 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79dead-7b2e-491e-8c26-d61024aea0a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:27.371960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79dead-7b2e-491e-8c26-d61024aea0a6 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:27.385848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1260/2531] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:29.137622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:29.260004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c90f37-b9da-40d4-be10-09002151dcae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:29.270227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:29.272590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:29.273444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:29.274500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] PATH_INFO: `/v3/users/8d64f0f197d14c07be22903e5f56143b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:29.277519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d64f0f197d14c07be22903e5f56143b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:29.283178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:29.714240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d64f0f197d14c07be22903e5f56143b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:29.821545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d64f0f197d14c07be22903e5f56143b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:29.822663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d64f0f197d14c07be22903e5f56143b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:29.838748 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d64f0f197d14c07be22903e5f56143b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:29.840134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d64f0f197d14c07be22903e5f56143b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:29.877091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1272/2532] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:29 2022] DELETE /identity/v3/users/8d64f0f197d14c07be22903e5f56143b => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:29.879434 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:29.879911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:29.879911 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:29.903189 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:29.907238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:29.981874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1261/2533] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:29.992584 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:29.994348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:30.003594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:30.077107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901cc1-8757-430b-8a36-83c82f7f68f7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:30.100695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:30.100695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:30.100695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:30.100695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:30.113229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:30.114814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:30.128157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1273/2534] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:30.678685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:30.683712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:30.694708 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9da2ba-1c5c-4076-a34e-bf8c662ed3ee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:30.704168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:30.705543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:30.705906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:30.706269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] PATH_INFO: `/v3/projects/0d4c5e2193794f7a8d054786c438df2f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:30.707880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4c5e2193794f7a8d054786c438df2f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:30.710466 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:30.917669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4c5e2193794f7a8d054786c438df2f', 'request_id': 'req-22ef7bda-b7e1-405c-9188-1cd7aef65c64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:30.921929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:30.935104 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4c5e2193794f7a8d054786c438df2f', 'request_id': 'req-22ef7bda-b7e1-405c-9188-1cd7aef65c64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:30.946745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4c5e2193794f7a8d054786c438df2f', 'request_id': 'req-22ef7bda-b7e1-405c-9188-1cd7aef65c64'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.329846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] The token cache is being invalidate because project 0d4c5e2193794f7a8d054786c438df2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:31.335233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.335233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22ef7bda-b7e1-405c-9188-1cd7aef65c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.335233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1262/2535] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:30 2022] DELETE /identity/v3/projects/0d4c5e2193794f7a8d054786c438df2f => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:31.341348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:31.358730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c40e3-37f2-4912-bcce-1318b642050a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:31.509960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:31.513772 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:31.514190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:31.514316 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] PATH_INFO: `/v3/users/f90228559d79490f96f408f6b216f301` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:31.515792 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90228559d79490f96f408f6b216f301)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:31.518053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:31.777064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90228559d79490f96f408f6b216f301'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.850536 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90228559d79490f96f408f6b216f301'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.852742 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90228559d79490f96f408f6b216f301'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.877760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90228559d79490f96f408f6b216f301'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.880081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90228559d79490f96f408f6b216f301'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:31.919836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1274/2536] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:31 2022] DELETE /identity/v3/users/f90228559d79490f96f408f6b216f301 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:32.420999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:32.421531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:32.421531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:32.442482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] MFA Rules not processed for user `acb62f60a71c441e92f4af065df81d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:32.444391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:32.524844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1263/2537] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:32.689875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:32.692087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:32.714462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:32.716029 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:32.785545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:32.843858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5369a7b-ef52-4594-9296-603b9a5c5187 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:32.850145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:32.851749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:32.851749 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:32.852200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] PATH_INFO: `/v3/users/b706a6c73a054e6ba4a22d413e1a3d53` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:32.854054 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b706a6c73a054e6ba4a22d413e1a3d53)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:32.856685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:32.873961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbce11-3f18-44bd-812b-661722476e65 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:32.887723 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:32.889571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:32.890211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:32.890720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] PATH_INFO: `/v3/projects/ce90a28c6e844d618e4d1461149b91b2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:32.892099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce90a28c6e844d618e4d1461149b91b2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:32.894158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:33.059551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce90a28c6e844d618e4d1461149b91b2', 'request_id': 'req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.070912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce90a28c6e844d618e4d1461149b91b2', 'request_id': 'req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.074340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b706a6c73a054e6ba4a22d413e1a3d53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.083375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce90a28c6e844d618e4d1461149b91b2', 'request_id': 'req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.122716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b706a6c73a054e6ba4a22d413e1a3d53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.123827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b706a6c73a054e6ba4a22d413e1a3d53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.137977 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b706a6c73a054e6ba4a22d413e1a3d53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.139039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-eb0ebbe2-0af1-4752-90ce-4580a57616a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b706a6c73a054e6ba4a22d413e1a3d53'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.170326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1275/2538] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:32 2022] DELETE /identity/v3/users/b706a6c73a054e6ba4a22d413e1a3d53 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:33.210443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] The token cache is being invalidate because project ce90a28c6e844d618e4d1461149b91b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:33.210950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.212146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a8bf412c-2b61-4253-b7b2-77ebabcf1b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:33.215076 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1264/2539] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:32 2022] DELETE /identity/v3/projects/ce90a28c6e844d618e4d1461149b91b2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:33.220963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:33.221466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:33.222267 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:33.265579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:33.267430 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:33.350138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1276/2540] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:33.362517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:33.363150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:33.363618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:33.408128 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:33.430609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:33.479894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1265/2541] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:33.480685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:33.494557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14905ad2-4f7c-464c-aca2-76792f61911d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:33.501025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:33.502673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:33.502673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:33.502673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:33.503512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:33.503861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:33.505781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:33.522811 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1277/2542] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:25:33.527914 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:33.539493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddede7-763c-4c6f-92e2-c57f33079d64 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:33.546040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:33.547062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:33.547768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:33.548233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:33.549385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:33.556837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:33.558014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:33.675459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1266/2543] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:33 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:33.682843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:33.694932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350d98-9689-4ef8-905f-2d5c8f6e733c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:33.716132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:33.718754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:33.831600 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:33.832705 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:33.833200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:33.835379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:33.836476 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:33.847756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:33.912405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b5080-3a5f-45e5-a262-e68708b538d0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:33.959440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:33.963243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:33.965940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:33.977536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] PATH_INFO: `/v3/projects/909802130f2948bcae9d2445f267a32c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:33.981884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909802130f2948bcae9d2445f267a32c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:33.987630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:34.011463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1278/2544] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:33 2022] POST /identity/v3/users => generated 288 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:34.012921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.058131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edab4f-5fc6-4c5c-a224-a84f346edbba admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:34.070052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:34.070981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.071427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.071892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.073425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:34.077696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:34.090439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1279/2545] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:34.094529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.106090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788e971-085a-48e8-9d91-3b1a0fb67365 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:34.111868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:34.112724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.113326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.113326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.114050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:34.116529 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:34.130059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1280/2546] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:25:34.134437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.144371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e3d8-74ac-4d1e-a2e2-972d0099302a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:34.153373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c756c3-adde-4801-919b-b1cfad2f76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:34.154437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c756c3-adde-4801-919b-b1cfad2f76de admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.154987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c756c3-adde-4801-919b-b1cfad2f76de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.155273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c756c3-adde-4801-919b-b1cfad2f76de admin admin] PATH_INFO: `/v3/projects/cd79919407fe474c90dc17f4d0cabcb2/users/0731d9cb9ea748c7855858d0dfc8d01b/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.173603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c756c3-adde-4801-919b-b1cfad2f76de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd79919407fe474c90dc17f4d0cabcb2, user_id=0731d9cb9ea748c7855858d0dfc8d01b, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:34.175659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c756c3-adde-4801-919b-b1cfad2f76de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:34.388286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1281/2547] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:34 2022] PUT /identity/v3/projects/cd79919407fe474c90dc17f4d0cabcb2/users/0731d9cb9ea748c7855858d0dfc8d01b/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:34.400060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.400462 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.400747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.419099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909802130f2948bcae9d2445f267a32c', 'request_id': 'req-8404c151-9be2-4c94-a5db-51aa4a752396'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:34.442436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909802130f2948bcae9d2445f267a32c', 'request_id': 'req-8404c151-9be2-4c94-a5db-51aa4a752396'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:34.453682 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909802130f2948bcae9d2445f267a32c', 'request_id': 'req-8404c151-9be2-4c94-a5db-51aa4a752396'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:34.459685 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] MFA Rules not processed for user `0731d9cb9ea748c7855858d0dfc8d01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:34.461208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:34.571463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1282/2548] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:34.578215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.598243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:34.603196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] The token cache is being invalidate because project 909802130f2948bcae9d2445f267a32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:34.604676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:34.605652 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8404c151-9be2-4c94-a5db-51aa4a752396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:34.607619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1267/2549] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:33 2022] DELETE /identity/v3/projects/909802130f2948bcae9d2445f267a32c => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:34.612877 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de86ad-8ce8-40d4-919e-856eac0c70df None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.613416 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de86ad-8ce8-40d4-919e-856eac0c70df None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.614580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de86ad-8ce8-40d4-919e-856eac0c70df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.672872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a8de86ad-8ce8-40d4-919e-856eac0c70df None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:34.679753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a8de86ad-8ce8-40d4-919e-856eac0c70df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:34.682023 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1b1f-1990-4445-9275-7a0b4a7bf89e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:34.688490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:34.689231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.689520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.689796 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.692235 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:34.694870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:34.711318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1268/2550] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:34.719477 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.719788 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.720015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.749365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:34.750863 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:34.764066 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1269/2551] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:34.765358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.777040 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bc2d1-297f-4ebb-9ca7-dc639710f5b1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:34.793541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:34.794239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:34.794526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:34.794794 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:34.795556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:34.795865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:34.797567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:34.820867 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1283/2552] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:34 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:34.828293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.835710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:34.846736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1270/2553] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:25:34.853242 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:34.898932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9a73-45ac-476c-b9c8-d1ec8a1d26fa admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.026132 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a0896-aa43-4004-bad1-cb4e34563fd1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.034263 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.035255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.035521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.036013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.037163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.039170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.053290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.054229 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.054576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.054965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.055963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.058126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.162159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:35.175376 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1271/2554] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:34 2022] POST /identity/v3/projects => generated 371 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:35.182471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.182678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1284/2555] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:34 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:35.188622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.228020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f52ff-a18c-4f55-9942-47cebeba3d81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.291482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac72c9-2cd9-41fa-a2f9-51099bd9bb7d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.297658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.298381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.298671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.298948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.299646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.302761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.309095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.309877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.310228 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.310570 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.312647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.314397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.331271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1285/2556] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:35.332676 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.344136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc5be-6ec8-48db-9840-e569bb66ad24 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.351779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.352907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.353281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.353604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] PATH_INFO: `/v3/projects/c125fd8cb1054fe0a7c7e869691aaa52/users/7244733cd58f4caeaa86265f4564374f/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.372693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c125fd8cb1054fe0a7c7e869691aaa52, user_id=7244733cd58f4caeaa86265f4564374f, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.377771 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.409013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1272/2557] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:35 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:35.410009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.412213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:35.492814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52e44-1a38-42e5-b8e8-e6f7da5ffc10 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.494507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1286/2558] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:35 2022] PUT /identity/v3/projects/c125fd8cb1054fe0a7c7e869691aaa52/users/7244733cd58f4caeaa86265f4564374f/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:35.497404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.577095 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1a55-e488-4594-bf4b-57471ff6ddf9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.586233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.587048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.587532 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.587666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.588329 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.588623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.588730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.589053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.589904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.591141 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:35.592368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.603785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.605554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.609715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1287/2559] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:35.609715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.617945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1273/2560] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:35.618853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.623653 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b4df-9220-47e6-b29d-073bb15842ea admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.629789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84fad2-8dc5-47d7-870a-30df20de7d25 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.636102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.636102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.636102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.636102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.636468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.636468 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.637375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.638050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.638331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.638605 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.639330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.641045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.652309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1288/2561] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:35.654490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.656459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1274/2562] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:35.657403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.666877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c1ad-5f42-46c5-b4d3-681b74be6d9d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.671131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3ab0-87f1-422f-9f5d-86d8ba1fc71b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.673857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5c250-7dcc-4e4e-af64-9145f5e1142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.675030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c250-7dcc-4e4e-af64-9145f5e1142a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.675419 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c250-7dcc-4e4e-af64-9145f5e1142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.675801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c250-7dcc-4e4e-af64-9145f5e1142a admin admin] PATH_INFO: `/v3/projects/c125fd8cb1054fe0a7c7e869691aaa52/users/7244733cd58f4caeaa86265f4564374f/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.677221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209b69-e6f8-4dee-9aba-1e9a78279a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.682052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5c250-7dcc-4e4e-af64-9145f5e1142a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c125fd8cb1054fe0a7c7e869691aaa52, user_id=7244733cd58f4caeaa86265f4564374f, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.682258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209b69-e6f8-4dee-9aba-1e9a78279a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.682258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209b69-e6f8-4dee-9aba-1e9a78279a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.682258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209b69-e6f8-4dee-9aba-1e9a78279a03 admin admin] PATH_INFO: `/v3/projects/7aec92c77fcc4f30b4f1e023cd5113e3/users/c043b94ce63e445ebab7e12ec4ac04d7/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.682522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5c250-7dcc-4e4e-af64-9145f5e1142a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.697767 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b209b69-e6f8-4dee-9aba-1e9a78279a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aec92c77fcc4f30b4f1e023cd5113e3, user_id=c043b94ce63e445ebab7e12ec4ac04d7, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:35.701046 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b209b69-e6f8-4dee-9aba-1e9a78279a03 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:35.706524 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1289/2563] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:35 2022] PUT /identity/v3/projects/c125fd8cb1054fe0a7c7e869691aaa52/users/7244733cd58f4caeaa86265f4564374f/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:35.718983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.719571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.720083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.727188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:35.767555 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] MFA Rules not processed for user `7244733cd58f4caeaa86265f4564374f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:35.768556 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:35.779986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1275/2564] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:35 2022] PUT /identity/v3/projects/7aec92c77fcc4f30b4f1e023cd5113e3/users/c043b94ce63e445ebab7e12ec4ac04d7/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:35.782770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.783061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.783378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.822232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] MFA Rules not processed for user `c043b94ce63e445ebab7e12ec4ac04d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:35.823465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:35.851435 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1290/2565] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:35.862270 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.866659 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:35.900822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1276/2566] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:35.913343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:35.914755 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:35.925373 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29976f7a-4e05-4e66-9f99-674325bb8cc6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:35.930960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:35.931650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:35.931947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:35.932193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:35.934181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:36.011893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:36.013397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:36.020771 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7cc45-5e92-4f27-8020-e0e974fb6165 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:36.027840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1291/2567] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:25:36.028289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:36.028994 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:36.029347 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:36.029883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:36.039403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:36.041134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:36.050718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1277/2568] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:36.619644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:36.907847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:39.481256 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:39.486945 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:39.563081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0a203-8aaf-408a-a608-33cd8b7ee185 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:39.568573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:39.569712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:39.570166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:39.570285 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] PATH_INFO: `/v3/users/0731d9cb9ea748c7855858d0dfc8d01b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:39.571656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0731d9cb9ea748c7855858d0dfc8d01b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:39.573955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:39.744508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:39.759648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ebd64-dbf1-446b-bc7d-761aac0c4464 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:39.765090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:39.766003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:39.766304 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:39.766581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] PATH_INFO: `/v3/users/c043b94ce63e445ebab7e12ec4ac04d7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:39.768298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c043b94ce63e445ebab7e12ec4ac04d7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:39.771395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:39.839251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0731d9cb9ea748c7855858d0dfc8d01b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:39.969181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0731d9cb9ea748c7855858d0dfc8d01b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:39.969960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0731d9cb9ea748c7855858d0dfc8d01b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:39.988825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0731d9cb9ea748c7855858d0dfc8d01b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:39.990403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f7e51db6-76a5-4d66-8242-e12f839b95a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0731d9cb9ea748c7855858d0dfc8d01b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:40.010234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1292/2569] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:39 2022] DELETE /identity/v3/users/0731d9cb9ea748c7855858d0dfc8d01b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:40.015144 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:40.015474 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:40.015785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:40.026436 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:40.035003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:40.037122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:40.047458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c043b94ce63e445ebab7e12ec4ac04d7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:40.048199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c043b94ce63e445ebab7e12ec4ac04d7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:40.048870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c043b94ce63e445ebab7e12ec4ac04d7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:40.123648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1293/2570] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:40.123893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c043b94ce63e445ebab7e12ec4ac04d7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:40.135956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:40.138576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:40.149696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b3b50ac-cff5-49f1-972b-018d8680a50e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c043b94ce63e445ebab7e12ec4ac04d7'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:40.184031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1278/2571] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:39 2022] DELETE /identity/v3/users/c043b94ce63e445ebab7e12ec4ac04d7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:40.186944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:40.187534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:40.188122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:40.215145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5833433-c2c7-495c-bfb4-585074d29092 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:40.217975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:40.219323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:40.285130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:40.286790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:40.288032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:40.288535 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:40.299323 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1279/2572] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:40.310003 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:40.322928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b9ef8-a9db-4d48-8fd6-740257f26bde None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:40.329159 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:40.330035 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:40.330451 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:40.330899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:40.346580 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:40.349072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:40.363356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1280/2573] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:25:40.390171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:40.392053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:40.401923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:40.410215 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1294/2574] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:41.022889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.023919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.025834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:41.027575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:41.041549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9f24-2759-41f0-ae82-bcb86be13664 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.047364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.048441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.049074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.053632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] PATH_INFO: `/v3/projects/7aec92c77fcc4f30b4f1e023cd5113e3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.053632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aec92c77fcc4f30b4f1e023cd5113e3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.053632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.082725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecd09b-ae7b-408a-aab6-54259c90d6dc service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.088619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.090098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.090372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.090655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] PATH_INFO: `/v3/projects/cd79919407fe474c90dc17f4d0cabcb2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.092724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd79919407fe474c90dc17f4d0cabcb2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.094841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.169185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aec92c77fcc4f30b4f1e023cd5113e3', 'request_id': 'req-046d4837-7d83-405b-b069-b59424a4b388'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.174703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aec92c77fcc4f30b4f1e023cd5113e3', 'request_id': 'req-046d4837-7d83-405b-b069-b59424a4b388'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.182489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aec92c77fcc4f30b4f1e023cd5113e3', 'request_id': 'req-046d4837-7d83-405b-b069-b59424a4b388'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.259497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd79919407fe474c90dc17f4d0cabcb2', 'request_id': 'req-3ca69305-e470-4fcd-9bf5-411a7ae2a344'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.280491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] The token cache is being invalidate because project 7aec92c77fcc4f30b4f1e023cd5113e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:41.281047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.282268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-046d4837-7d83-405b-b069-b59424a4b388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.285351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1281/2575] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:41 2022] DELETE /identity/v3/projects/7aec92c77fcc4f30b4f1e023cd5113e3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:41.293705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af3c76-bfb7-49b2-9ab3-56b0fe9a5e12 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.294211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af3c76-bfb7-49b2-9ab3-56b0fe9a5e12 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.294725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af3c76-bfb7-49b2-9ab3-56b0fe9a5e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.318048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-24af3c76-bfb7-49b2-9ab3-56b0fe9a5e12 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:41.319280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-24af3c76-bfb7-49b2-9ab3-56b0fe9a5e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:41.384307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1282/2576] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:41.385074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd79919407fe474c90dc17f4d0cabcb2', 'request_id': 'req-3ca69305-e470-4fcd-9bf5-411a7ae2a344'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.392222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd79919407fe474c90dc17f4d0cabcb2', 'request_id': 'req-3ca69305-e470-4fcd-9bf5-411a7ae2a344'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.392526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.392821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.393114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.398528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:41.410138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] The token cache is being invalidate because project cd79919407fe474c90dc17f4d0cabcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:41.410647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.412489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.415074 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1295/2577] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:41 2022] DELETE /identity/v3/projects/cd79919407fe474c90dc17f4d0cabcb2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:41.418564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:41.419168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.420537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:41.420663 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:41.435154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca69305-e470-4fcd-9bf5-411a7ae2a344 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.439354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1283/2578] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:41.440835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.440960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.441873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.442126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.443312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] PATH_INFO: `/v3/users/7244733cd58f4caeaa86265f4564374f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.444850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7244733cd58f4caeaa86265f4564374f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.447149 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.452123 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b71ff-ee70-4f1d-8ac6-fb589036f2e3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.457291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.458741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.463524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.463524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.463524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:41.463524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.463524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.479333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1284/2579] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:25:41.480948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.495324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856124cd-9eb9-4957-a626-962b1c8f7b26 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.502292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.503377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.503900 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.504186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.506125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.508188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.656632 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1285/2580] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:41 2022] POST /identity/v3/projects => generated 357 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:41.661065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.697383 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7244733cd58f4caeaa86265f4564374f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.728489 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bca49e-2fdc-4f31-be05-560818d4ef38 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.733257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.733925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.734209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.734486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.735173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.737207 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.768078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:41.784486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7244733cd58f4caeaa86265f4564374f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.785195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7244733cd58f4caeaa86265f4564374f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.793971 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7244733cd58f4caeaa86265f4564374f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.795011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7244733cd58f4caeaa86265f4564374f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:41.817268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1296/2581] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:25:41 2022] DELETE /identity/v3/users/7244733cd58f4caeaa86265f4564374f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:41.851364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1286/2582] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:41 2022] POST /identity/v3/users => generated 279 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:41.859599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.861928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:41.945371 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16bfd9-7a22-47bc-8a5f-3272e4d4bbeb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.953134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.953946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.954112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.954390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.960947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.960947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:41.969947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1297/2583] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:41.974868 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:41.994136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14e374-2738-4973-adbd-6aaa4f6e1637 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:41.994136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af16c2-7223-4ef5-b8bc-ebf6abd3e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:41.994136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af16c2-7223-4ef5-b8bc-ebf6abd3e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:41.994136 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af16c2-7223-4ef5-b8bc-ebf6abd3e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:41.994669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af16c2-7223-4ef5-b8bc-ebf6abd3e9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:41.994669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af16c2-7223-4ef5-b8bc-ebf6abd3e9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:41.994669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af16c2-7223-4ef5-b8bc-ebf6abd3e9c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.003484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1287/2584] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:42.008349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.020190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d69d7a-e48f-44ca-a9e2-ebfcdc934fdf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.026229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.027339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.027597 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.030037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] PATH_INFO: `/v3/projects/6a500824ea2540c0806a3cbf7d1c2ddd/users/a12181e84beb4b80ba33401ccc6a1a2a/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.047872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a500824ea2540c0806a3cbf7d1c2ddd, user_id=a12181e84beb4b80ba33401ccc6a1a2a, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.050817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.122953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1298/2585] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:42 2022] PUT /identity/v3/projects/6a500824ea2540c0806a3cbf7d1c2ddd/users/a12181e84beb4b80ba33401ccc6a1a2a/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:25:42.147528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.150205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.150205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.201051 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] MFA Rules not processed for user `a12181e84beb4b80ba33401ccc6a1a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:42.203716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:42.295466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.297930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:42.305533 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:42.326303 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1288/2586] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:42.334081 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.377691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:42.381318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e71f7-661b-40d1-a26f-5c3d186688ca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.386721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.387707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.387992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.388268 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] PATH_INFO: `/v3/projects/c125fd8cb1054fe0a7c7e869691aaa52` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.389582 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c125fd8cb1054fe0a7c7e869691aaa52)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.392102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.424266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041298c2-e54c-4c13-a3bc-fea5ddb8e8b4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.430910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.431702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.431989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.432267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.433005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.435378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.538986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c125fd8cb1054fe0a7c7e869691aaa52', 'request_id': 'req-67c4c89a-6f3e-451a-b4f2-29920dedd27d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:42.560113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1289/2587] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/projects => generated 357 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:25:42.564606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.608585 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c125fd8cb1054fe0a7c7e869691aaa52', 'request_id': 'req-67c4c89a-6f3e-451a-b4f2-29920dedd27d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:42.617102 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c125fd8cb1054fe0a7c7e869691aaa52', 'request_id': 'req-67c4c89a-6f3e-451a-b4f2-29920dedd27d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:42.637548 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] The token cache is being invalidate because project c125fd8cb1054fe0a7c7e869691aaa52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:25:42.638009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:42.639035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-67c4c89a-6f3e-451a-b4f2-29920dedd27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:25:42.641764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1299/2588] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:25:42 2022] DELETE /identity/v3/projects/c125fd8cb1054fe0a7c7e869691aaa52 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:42.647547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144d309-9b99-4f18-b300-1f08d38547c2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.652008 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7988-12a3-4029-a11b-0390c8c103ea None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.652452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7988-12a3-4029-a11b-0390c8c103ea None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.655114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7988-12a3-4029-a11b-0390c8c103ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.655789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.656886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.657355 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.657828 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.659016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.663566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.683232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2b4f7988-12a3-4029-a11b-0390c8c103ea None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:42.684544 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2b4f7988-12a3-4029-a11b-0390c8c103ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:42.694072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1300/2589] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:42.702694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.702968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.703239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.725115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:42.729465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:42.737642 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1301/2590] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:42.743988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.754513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde02176-0bfc-4c62-b0e1-00684bfa6882 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.762687 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.764444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.764444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.769258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.769258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:25:42.769258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.769258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.769884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1290/2591] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:42.775074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.777487 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:42.785814 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1302/2592] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:25:42.792145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.793535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60657e-a80b-4b69-92df-7ff57b6877bb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.799048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.799730 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.800014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.800295 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.801226 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.803092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.807946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea394-a507-4c11-8345-da603ac365fe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.815415 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1291/2593] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:25:42.816850 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.817630 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.817976 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.818719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.819506 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.819779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.821870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.834604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea78fb-7647-4bd6-921e-558ebdec93ad admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:42.842426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:42.843693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:42.844200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:42.844661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] PATH_INFO: `/v3/projects/ad6da932b79e4867b48db75e4d1926d9/users/3d95c85752204ba0a16e10482a601434/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:42.867363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6da932b79e4867b48db75e4d1926d9, user_id=3d95c85752204ba0a16e10482a601434, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:42.870151 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:42.981318 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1303/2594] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/projects => generated 367 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:42.984439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:42.988701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1292/2595] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:42 2022] PUT /identity/v3/projects/ad6da932b79e4867b48db75e4d1926d9/users/3d95c85752204ba0a16e10482a601434/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:42.994520 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.028325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:43.070471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4b7ea-88df-412d-8987-bdc1c6010994 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.077856 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.078182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9436c3-809e-4d47-b488-08af01fbf85f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.078737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.079174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.079460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.080190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.082250 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.085459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.086147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.086425 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.086696 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.087428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.089083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.100396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1293/2596] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:43.104697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.116073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366b20-aeae-4b65-a7b4-d3192c4a20a9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.121714 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1a4f7-a612-45c3-983f-a38db4acd226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.122945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1a4f7-a612-45c3-983f-a38db4acd226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.123287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1a4f7-a612-45c3-983f-a38db4acd226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.123564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1a4f7-a612-45c3-983f-a38db4acd226 admin admin] PATH_INFO: `/v3/projects/ad6da932b79e4867b48db75e4d1926d9/users/3d95c85752204ba0a16e10482a601434/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.125803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1a4f7-a612-45c3-983f-a38db4acd226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6da932b79e4867b48db75e4d1926d9, user_id=3d95c85752204ba0a16e10482a601434, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.128907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1a4f7-a612-45c3-983f-a38db4acd226 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.143505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1294/2597] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:43 2022] PUT /identity/v3/projects/ad6da932b79e4867b48db75e4d1926d9/users/3d95c85752204ba0a16e10482a601434/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:43.162335 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.163004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.163004 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.199935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] MFA Rules not processed for user `3d95c85752204ba0a16e10482a601434`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:43.201246 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:43.225599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1304/2598] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:25:42 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:25:43.229962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.252190 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1f5f9-6084-41ef-8654-ab2ed9a18035 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.291307 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:43.346118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1295/2599] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:25:43.346378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.346378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.346378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.346378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.347449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.350171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.355224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.357988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:43.369140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1305/2600] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:25:43.370163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.383708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697e6a5-1ed7-43e5-9ecd-59231d9c6808 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.394666 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.395495 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.395947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.396947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.397791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.399521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.410851 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1306/2601] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:25:43.417051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.433959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc2a9c-21fb-4cd6-ab84-9387ef99dd9f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.439246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.440146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.440429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.440822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] PATH_INFO: `/v3/projects/4248255a46534542b269988b76a5feb9/users/63d451e4d0104cc89f45a42f804fa860/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.452655 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721a294-cbbc-4358-83f2-1f0c22ad59ce None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.457314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32941-d96f-421a-9278-c37bea308519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.458433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32941-d96f-421a-9278-c37bea308519 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.458722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32941-d96f-421a-9278-c37bea308519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.459000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32941-d96f-421a-9278-c37bea308519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.460891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4248255a46534542b269988b76a5feb9, user_id=63d451e4d0104cc89f45a42f804fa860, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.464210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.469390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32941-d96f-421a-9278-c37bea308519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.470894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32941-d96f-421a-9278-c37bea308519 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.482614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1296/2602] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:25:43.624588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1307/2603] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:25:43 2022] PUT /identity/v3/projects/4248255a46534542b269988b76a5feb9/users/63d451e4d0104cc89f45a42f804fa860/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:25:43.626624 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.627859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.627859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.675268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] MFA Rules not processed for user `63d451e4d0104cc89f45a42f804fa860`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:25:43.676556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:43.713278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:43.768941 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1297/2604] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:25:43.791282 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.793580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:43.799781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:43.873640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb2af3-3b8b-47a8-b51a-85cadee8129e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.877710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.878300 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.878583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.878857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.889783 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:43.892922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:43.897819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a8392-66fe-4bcd-bf75-7291afff965a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:43.901947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:43.902609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:43.902885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:43.903481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:43.907259 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:43.910010 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1308/2605] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:44.025770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:44.030158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:44.049973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1298/2606] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:25:49.892491 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:25:49.895185 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:49.970541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115e7e2-c199-4392-9ec8-410bc840330f service glance] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:25:49.974674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:25:49.975351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:25:49.975632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:25:49.975901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:25:49.977795 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:25:50.042262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:25:50.076650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:25:50.080077 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff163044-891a-4ea3-baf4-2138100f408c service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:25:50.098273 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1309/2607] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:25:54.084050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=64 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:00.202115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=8 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:05.264766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:05.334084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef3b18-e565-4c68-b1c8-5a88fb752ec8 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:05.339163 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:05.340053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:05.340326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:05.340600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] PATH_INFO: `/v3/users/a12181e84beb4b80ba33401ccc6a1a2a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:05.341882 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12181e84beb4b80ba33401ccc6a1a2a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:05.343818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:05.587452 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12181e84beb4b80ba33401ccc6a1a2a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:05.588026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12181e84beb4b80ba33401ccc6a1a2a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:05.588622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12181e84beb4b80ba33401ccc6a1a2a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:05.693357 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12181e84beb4b80ba33401ccc6a1a2a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:05.707210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12181e84beb4b80ba33401ccc6a1a2a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:05.722504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1299/2608] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:05 2022] DELETE /identity/v3/users/a12181e84beb4b80ba33401ccc6a1a2a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:05.728605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:05.729153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:05.729254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:05.747718 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:05.749170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:05.822058 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1310/2609] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:05.832056 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:05.833501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:05.892495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da552e-2471-45ab-b126-91c49b8a4bc1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:05.899043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:05.899412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:05.899694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:05.899972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:05.910439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:05.911874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:05.922834 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1300/2610] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:06.375629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:06.377272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:06.402172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ded21-47c6-4310-bf46-d09060cb8901 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:06.402172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:06.402172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:06.402172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:06.402999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] PATH_INFO: `/v3/projects/6a500824ea2540c0806a3cbf7d1c2ddd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:06.402999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a500824ea2540c0806a3cbf7d1c2ddd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:06.402999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:06.542494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a500824ea2540c0806a3cbf7d1c2ddd', 'request_id': 'req-94cf4fca-70dc-4e5c-8138-21e81ce7159c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:06.665009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a500824ea2540c0806a3cbf7d1c2ddd', 'request_id': 'req-94cf4fca-70dc-4e5c-8138-21e81ce7159c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:06.672735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a500824ea2540c0806a3cbf7d1c2ddd', 'request_id': 'req-94cf4fca-70dc-4e5c-8138-21e81ce7159c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:06.685847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] The token cache is being invalidate because project 6a500824ea2540c0806a3cbf7d1c2ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:06.686152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:06.686832 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:06.688403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1311/2611] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:06 2022] DELETE /identity/v3/projects/6a500824ea2540c0806a3cbf7d1c2ddd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:06.693108 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:06.706620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb11db-6f67-451f-bbfb-669808753521 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:06.741913 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:06.789320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:06.790208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:06.790497 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:06.790769 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] PATH_INFO: `/v3/users/3d95c85752204ba0a16e10482a601434` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:06.791999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d95c85752204ba0a16e10482a601434)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:06.794326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:07.025563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d95c85752204ba0a16e10482a601434'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.026706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d95c85752204ba0a16e10482a601434'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.027429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d95c85752204ba0a16e10482a601434'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.133429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d95c85752204ba0a16e10482a601434'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.151084 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9422fc8e-ff54-4461-b487-53a26e9e19b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d95c85752204ba0a16e10482a601434'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.172576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1301/2612] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:06 2022] DELETE /identity/v3/users/3d95c85752204ba0a16e10482a601434 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:07.597559 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:07.599093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:07.619021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf4fca-70dc-4e5c-8138-21e81ce7159c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:07.686499 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:07.687366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:07.687679 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:07.687956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] PATH_INFO: `/v3/projects/ad6da932b79e4867b48db75e4d1926d9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:07.689172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6da932b79e4867b48db75e4d1926d9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:07.691092 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:07.780727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:07.797779 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6da932b79e4867b48db75e4d1926d9', 'request_id': 'req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.875995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6da932b79e4867b48db75e4d1926d9', 'request_id': 'req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.882111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6da932b79e4867b48db75e4d1926d9', 'request_id': 'req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.893890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] The token cache is being invalidate because project ad6da932b79e4867b48db75e4d1926d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:07.894175 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.894870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-be8bcd0c-f8aa-4117-b5c8-a7b3d64b613d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:07.896470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1312/2613] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:07 2022] DELETE /identity/v3/projects/ad6da932b79e4867b48db75e4d1926d9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:07.901992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:07.902855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:07.902855 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:07.922638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:07.923850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:07.986138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1302/2614] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:26:07.994734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:07.995015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:07.995293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.017689 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:08.018979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:08.027833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1313/2615] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:08.032548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.043669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75c45-55cd-4d31-9a67-ec297cab48fe None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.050364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.051036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.051320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.051676 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.052315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:26:08.052615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.054959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.067263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1303/2616] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:26:08.072399 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.081864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabffd17-879d-4f3d-bd38-56366b892252 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.086776 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.087436 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.087724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.088000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.088714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.090640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.198380 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1314/2617] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:26:08 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:26:08.202548 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.212835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609846-0b30-4db9-8c95-a135f2d3911f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.239909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:08.273934 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.274602 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.274936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.275157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.275850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.277907 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.375959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1304/2618] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:26:08 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:26:08.380357 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.391872 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201f46f-0f51-47ce-abd0-f43a59c190b7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.397007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.398140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.398416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.398695 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.399408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.401734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.414443 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1315/2619] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:26:08.422289 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.433840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb0d7-1ca2-4e8a-b960-84c8ac8ab8c4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.438758 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bfd2e-000f-4c80-9cb4-84432d754ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.439413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bfd2e-000f-4c80-9cb4-84432d754ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.439689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bfd2e-000f-4c80-9cb4-84432d754ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.439961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bfd2e-000f-4c80-9cb4-84432d754ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.440709 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bfd2e-000f-4c80-9cb4-84432d754ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.442328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bfd2e-000f-4c80-9cb4-84432d754ce0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.453253 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1305/2620] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:26:08.457533 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.468595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176882dc-5028-4230-90f9-1c35d11b7606 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.473326 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.474198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.474513 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.475395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] PATH_INFO: `/v3/projects/5414e988cc2b40ef9becfe19aaf09147/users/55405a8ae238448f859e804c537d3c55/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.491901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5414e988cc2b40ef9becfe19aaf09147, user_id=55405a8ae238448f859e804c537d3c55, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.494844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.590410 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1316/2621] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:26:08 2022] PUT /identity/v3/projects/5414e988cc2b40ef9becfe19aaf09147/users/55405a8ae238448f859e804c537d3c55/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:08.610969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.611591 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.612094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.653503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] MFA Rules not processed for user `55405a8ae238448f859e804c537d3c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:08.654760 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:08.728063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1306/2622] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:08.732594 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.798365 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb714cd-bfde-4127-b357-ddcfba4ff347 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.803205 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.803864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.804146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.804424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.805145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.807114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:08.877694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1317/2623] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:26:08 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:26:08.881735 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:08.893080 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88d1f3-b662-4b9d-8cb3-95c69953d19b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:08.950852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:08.951618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:08.951782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:08.952043 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:08.952732 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:08.954741 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:09.066556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1307/2624] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:26:08 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:26:09.071327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:09.082053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95460b-6cc1-4df9-83a3-16fe5be89a99 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:09.087828 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:09.088494 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:09.088777 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:09.089090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:09.089810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:09.091439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:09.102238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1318/2625] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:26:09.106534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:09.117890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d5a0c-26c8-45d9-924e-2371ece42906 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:09.122645 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:09.123550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:09.123826 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:09.124097 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] PATH_INFO: `/v3/projects/aa6c90f7eb4342ef9d673a8160c7da72/users/47a97b8c07bd46b5808793efbf747bbf/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:09.140745 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6c90f7eb4342ef9d673a8160c7da72, user_id=47a97b8c07bd46b5808793efbf747bbf, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:09.143119 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:09.225307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1308/2626] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:26:09 2022] PUT /identity/v3/projects/aa6c90f7eb4342ef9d673a8160c7da72/users/47a97b8c07bd46b5808793efbf747bbf/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:09.233157 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:09.241682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa972f60-0acd-4070-a4b3-e5cf355106d8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:09.263606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:09.301103 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1158-5d46-40ad-be62-3cd5a61d0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:09.301774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1158-5d46-40ad-be62-3cd5a61d0230 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:09.302057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1158-5d46-40ad-be62-3cd5a61d0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:09.302330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1158-5d46-40ad-be62-3cd5a61d0230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:09.303131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1158-5d46-40ad-be62-3cd5a61d0230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:09.304716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1158-5d46-40ad-be62-3cd5a61d0230 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:09.319266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1319/2627] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:26:09.319899 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:09.325476 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:09.331287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c62f8b-38d1-4a13-8bf0-c42abaed8f68 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:09.337287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:09.345015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:09.345015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:09.345015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] PATH_INFO: `/v3/projects/aa6c90f7eb4342ef9d673a8160c7da72/users/47a97b8c07bd46b5808793efbf747bbf/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:09.345015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6c90f7eb4342ef9d673a8160c7da72, user_id=47a97b8c07bd46b5808793efbf747bbf, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:09.345015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:09.354462 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1309/2628] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:26:09 2022] PUT /identity/v3/projects/aa6c90f7eb4342ef9d673a8160c7da72/users/47a97b8c07bd46b5808793efbf747bbf/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:09.364879 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:09.365169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:09.365595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:09.393081 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] MFA Rules not processed for user `47a97b8c07bd46b5808793efbf747bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:09.394354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:09.466721 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1320/2629] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:09.478166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:09.479815 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:09.540797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b24ad-8743-4549-b32a-9b335e964207 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:09.544543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:09.545225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:09.545504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:09.545772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:09.607516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:09.608915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:09.618896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1310/2630] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:18.955161 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:18.956935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:18.970734 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f49c9-0f0e-421d-a63d-cf12d5c2f938 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:18.974577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c7d8c-f320-4b7f-9bf0-eb02aa5e71e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:18.975325 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7d8c-f320-4b7f-9bf0-eb02aa5e71e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:18.975710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7d8c-f320-4b7f-9bf0-eb02aa5e71e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:18.976806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c7d8c-f320-4b7f-9bf0-eb02aa5e71e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:18.987140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c7d8c-f320-4b7f-9bf0-eb02aa5e71e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:18.988482 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c7d8c-f320-4b7f-9bf0-eb02aa5e71e0 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:18.999057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1321/2631] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:19.614182 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:26.636513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:26.638085 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:26.789233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f7e66-e91a-4e0e-892f-31e9b340108e service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:26.796026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:26.797739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:26.798098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:26.798469 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] PATH_INFO: `/v3/users/63d451e4d0104cc89f45a42f804fa860` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:26.800247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d451e4d0104cc89f45a42f804fa860)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:26.803243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:27.004546 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d451e4d0104cc89f45a42f804fa860'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:27.005386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d451e4d0104cc89f45a42f804fa860'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:27.006237 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d451e4d0104cc89f45a42f804fa860'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:27.144761 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d451e4d0104cc89f45a42f804fa860'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:27.163067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d451e4d0104cc89f45a42f804fa860'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:27.181424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1311/2632] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:26 2022] DELETE /identity/v3/users/63d451e4d0104cc89f45a42f804fa860 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:27.188449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:27.189644 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:27.190044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:27.215385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:27.216983 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:27.335930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1322/2633] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:26:27.346261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:27.348909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:27.450203 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947195-f2ef-47f3-8c42-a9028a87ce77 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:27.456691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8002c64-6180-4cac-8abb-c5b520f33ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:27.456986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002c64-6180-4cac-8abb-c5b520f33ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:27.457363 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002c64-6180-4cac-8abb-c5b520f33ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:27.457754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8002c64-6180-4cac-8abb-c5b520f33ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:27.468673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002c64-6180-4cac-8abb-c5b520f33ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:27.470807 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8002c64-6180-4cac-8abb-c5b520f33ba0 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:27.487381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1312/2634] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:28.225404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:28.228702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:28.270293 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929cce-3f8a-4361-ac97-5137a841b349 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:28.279802 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:28.282033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:28.282636 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:28.283298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] PATH_INFO: `/v3/projects/4248255a46534542b269988b76a5feb9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:28.285926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4248255a46534542b269988b76a5feb9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:28.288953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:28.450464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:28.477578 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4248255a46534542b269988b76a5feb9', 'request_id': 'req-9a49be1e-7367-4faf-8742-c78c7beccaa4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:28.579233 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4248255a46534542b269988b76a5feb9', 'request_id': 'req-9a49be1e-7367-4faf-8742-c78c7beccaa4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:28.593616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4248255a46534542b269988b76a5feb9', 'request_id': 'req-9a49be1e-7367-4faf-8742-c78c7beccaa4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:28.612781 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] The token cache is being invalidate because project 4248255a46534542b269988b76a5feb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:28.613204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:28.614197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9a49be1e-7367-4faf-8742-c78c7beccaa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:28.620254 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1323/2635] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:28 2022] DELETE /identity/v3/projects/4248255a46534542b269988b76a5feb9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:28.622924 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:28.623441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:28.623742 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:28.644969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:28.646244 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:28.671874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:28.729579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1313/2636] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:28.738198 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:28.739061 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:28.739512 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:28.774162 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:28.775724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:28.790634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1324/2637] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:28.795770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:28.807512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097a51d-2ff7-4e89-8493-ae524d28a9c8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:28.812183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:28.812898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:28.813174 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:28.813446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:28.814173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:26:28.814481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:28.816216 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:28.830887 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1314/2638] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:26:28.836453 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:28.851994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6dae-13a7-4664-88e0-726abe77f2ab None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:28.857189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:28.857858 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:28.858136 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:28.858409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:28.859333 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:28.862933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:28.993120 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1325/2639] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:26:28 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:26:28.997717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:29.009915 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595259-3951-43a7-bed1-e4ebee770352 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:29.096806 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:29.097997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:29.098459 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:29.098912 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:29.100120 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:29.103850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:29.191400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1315/2640] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:26:28 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:26:29.198509 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:29.216970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf8f7-e91f-4a33-8243-ae71030b6f6d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:29.224121 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:29.225171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:29.225459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:29.226729 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:29.226930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:29.228606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:29.241097 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1326/2641] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:26:29.246061 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:29.259665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd40b3-0ef2-46dc-98de-249358364ce8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:29.264749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87108fd7-de7d-47f0-877c-fa1b96b819bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:29.265464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87108fd7-de7d-47f0-877c-fa1b96b819bf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:29.265749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87108fd7-de7d-47f0-877c-fa1b96b819bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:29.266018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87108fd7-de7d-47f0-877c-fa1b96b819bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:29.266753 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87108fd7-de7d-47f0-877c-fa1b96b819bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:29.268368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87108fd7-de7d-47f0-877c-fa1b96b819bf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:29.280865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1316/2642] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:26:29.286159 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:29.297866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492c30c-7ad8-47b4-97cb-f7e1dd73313a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:29.303091 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:29.304907 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:29.305309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:29.305696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] PATH_INFO: `/v3/projects/dd25492e02dd4e76af91a585495aad90/users/5d0509be92e94bfca6e7ab081426d4e1/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:29.323655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd25492e02dd4e76af91a585495aad90, user_id=5d0509be92e94bfca6e7ab081426d4e1, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:29.326588 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:29.431820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1327/2643] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:26:29 2022] PUT /identity/v3/projects/dd25492e02dd4e76af91a585495aad90/users/5d0509be92e94bfca6e7ab081426d4e1/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:26:29.442590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:29.442876 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:29.443158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:29.474206 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] MFA Rules not processed for user `5d0509be92e94bfca6e7ab081426d4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:29.475503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:29.577125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1317/2644] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:29.590936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:29.593001 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:29.666013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc766c-ce25-4a97-b215-5c8181db5a1e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:29.669990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d755c-0e5c-49b1-b1bf-d569a4fce066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:29.670651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d755c-0e5c-49b1-b1bf-d569a4fce066 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:29.670929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d755c-0e5c-49b1-b1bf-d569a4fce066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:29.671202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d755c-0e5c-49b1-b1bf-d569a4fce066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:29.681975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d755c-0e5c-49b1-b1bf-d569a4fce066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:29.683660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d755c-0e5c-49b1-b1bf-d569a4fce066 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:29.694565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1328/2645] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:26:33.153697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:33.176592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:33.228036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615503-ea10-42d7-a18b-d350ee403385 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:33.233047 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:33.233953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:33.234234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:33.234517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] PATH_INFO: `/v3/users/5d0509be92e94bfca6e7ab081426d4e1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:33.235838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0509be92e94bfca6e7ab081426d4e1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:33.237860 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:33.447225 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0509be92e94bfca6e7ab081426d4e1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:33.447894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0509be92e94bfca6e7ab081426d4e1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:33.448506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0509be92e94bfca6e7ab081426d4e1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:33.549928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0509be92e94bfca6e7ab081426d4e1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:33.569702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0509be92e94bfca6e7ab081426d4e1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:33.585372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1318/2646] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:33 2022] DELETE /identity/v3/users/5d0509be92e94bfca6e7ab081426d4e1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:26:33.590808 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:33.591686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:33.591686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:33.620545 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:33.622471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:33.688427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:33.701665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1329/2647] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:26:33.712183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:33.717516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:33.789850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0517b-3bdb-444b-b5ba-63bc1e1d0899 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:33.789850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11374516-6c87-46f7-ac9d-ce47136daa75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:33.790454 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374516-6c87-46f7-ac9d-ce47136daa75 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:33.790740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374516-6c87-46f7-ac9d-ce47136daa75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:33.791016 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11374516-6c87-46f7-ac9d-ce47136daa75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:33.801479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11374516-6c87-46f7-ac9d-ce47136daa75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:33.802946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11374516-6c87-46f7-ac9d-ce47136daa75 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:33.814176 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1319/2648] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:34.383804 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:34.385682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:34.406880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144f4a-b242-4477-a858-21676b88e12d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:34.418104 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:34.420343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:34.420986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:34.421502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] PATH_INFO: `/v3/projects/dd25492e02dd4e76af91a585495aad90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:34.425114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd25492e02dd4e76af91a585495aad90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:34.428595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:34.577686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd25492e02dd4e76af91a585495aad90', 'request_id': 'req-dee1b29e-c8bd-4587-9fcb-66301b38eaca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:34.652985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd25492e02dd4e76af91a585495aad90', 'request_id': 'req-dee1b29e-c8bd-4587-9fcb-66301b38eaca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:34.661758 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd25492e02dd4e76af91a585495aad90', 'request_id': 'req-dee1b29e-c8bd-4587-9fcb-66301b38eaca'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:34.681471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] The token cache is being invalidate because project dd25492e02dd4e76af91a585495aad90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:34.681882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:34.682877 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:34.684873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1330/2649] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:34 2022] DELETE /identity/v3/projects/dd25492e02dd4e76af91a585495aad90 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:43.809209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:44.672616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:44.677050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:44.677358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:44.677646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:44.695920 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:44.697749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:44.754442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1320/2650] 10.222.0.71 () {58 vars in 967 bytes} [Wed May 18 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:44.926752 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:44.928209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:45.008560 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1b29e-c8bd-4587-9fcb-66301b38eaca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:45.014418 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d61011-acca-422e-806b-075a450142d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:45.015122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61011-acca-422e-806b-075a450142d4 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:45.016154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61011-acca-422e-806b-075a450142d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:45.016604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d61011-acca-422e-806b-075a450142d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:45.028762 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61011-acca-422e-806b-075a450142d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:45.030613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d61011-acca-422e-806b-075a450142d4 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:45.040612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1331/2651] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:26:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:26:47.402219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:47.404598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:47.515511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c02ea1-df50-49da-bd5e-6ad536fe9173 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:47.522258 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:47.523338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:47.523623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:47.524529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] PATH_INFO: `/v3/users/55405a8ae238448f859e804c537d3c55` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:47.526191 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55405a8ae238448f859e804c537d3c55)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:47.528331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:47.743661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55405a8ae238448f859e804c537d3c55'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:47.744871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55405a8ae238448f859e804c537d3c55'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:47.745976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55405a8ae238448f859e804c537d3c55'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:47.812927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55405a8ae238448f859e804c537d3c55'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:47.840588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55405a8ae238448f859e804c537d3c55'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:47.869818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1321/2652] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:47 2022] DELETE /identity/v3/users/55405a8ae238448f859e804c537d3c55 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:47.878323 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:47.878921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:47.878921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:47.902260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:47.903516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:47.989174 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1332/2653] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:47.996610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:47.998236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:48.032075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:48.072955 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3c4f4-5fb9-4e35-a604-cd217a100b58 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:48.076932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:48.077703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:48.078086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:48.078748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:48.091584 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:48.093440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:48.106078 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1322/2654] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:48.712973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:48.714412 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:48.727248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cb249-507c-4a8d-9fd6-dc1962eb413a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:48.733101 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:48.734226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:48.734741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:48.735390 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] PATH_INFO: `/v3/projects/5414e988cc2b40ef9becfe19aaf09147` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:48.736932 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5414e988cc2b40ef9becfe19aaf09147)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:48.739897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:48.896838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5414e988cc2b40ef9becfe19aaf09147', 'request_id': 'req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.001119 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5414e988cc2b40ef9becfe19aaf09147', 'request_id': 'req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.008634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5414e988cc2b40ef9becfe19aaf09147', 'request_id': 'req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.021328 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] The token cache is being invalidate because project 5414e988cc2b40ef9becfe19aaf09147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:49.021617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.022402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.026426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1333/2655] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:48 2022] DELETE /identity/v3/projects/5414e988cc2b40ef9becfe19aaf09147 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:49.040775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:49.050651 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827125-bbf7-4077-92e8-27f4f799801f service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:49.124957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:49.126201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:49.126648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:49.127186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] PATH_INFO: `/v3/users/47a97b8c07bd46b5808793efbf747bbf` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:49.128560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a97b8c07bd46b5808793efbf747bbf)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:49.130720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:49.319274 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a97b8c07bd46b5808793efbf747bbf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.320011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a97b8c07bd46b5808793efbf747bbf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.320610 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a97b8c07bd46b5808793efbf747bbf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.418350 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a97b8c07bd46b5808793efbf747bbf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.437193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-22dd2577-7f23-4321-ae57-2259b5781251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a97b8c07bd46b5808793efbf747bbf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:49.457635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1323/2656] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:49 2022] DELETE /identity/v3/users/47a97b8c07bd46b5808793efbf747bbf => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:26:50.103835 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:50.106275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:50.136108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6ba1-768d-47ad-8a4a-cb12c5aa14c4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:50.157335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:50.279525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:50.280987 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:50.281278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:50.288211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] PATH_INFO: `/v3/projects/aa6c90f7eb4342ef9d673a8160c7da72` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:50.288211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6c90f7eb4342ef9d673a8160c7da72)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:50.288211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:50.456278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6c90f7eb4342ef9d673a8160c7da72', 'request_id': 'req-f985cc1f-0b71-482c-b684-e896de223923'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:50.596065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6c90f7eb4342ef9d673a8160c7da72', 'request_id': 'req-f985cc1f-0b71-482c-b684-e896de223923'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:50.618502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6c90f7eb4342ef9d673a8160c7da72', 'request_id': 'req-f985cc1f-0b71-482c-b684-e896de223923'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:50.638126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] The token cache is being invalidate because project aa6c90f7eb4342ef9d673a8160c7da72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:50.638425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:50.639088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f985cc1f-0b71-482c-b684-e896de223923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:50.641339 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1334/2657] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:50 2022] DELETE /identity/v3/projects/aa6c90f7eb4342ef9d673a8160c7da72 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:50.646928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:50.647458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:50.647458 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:50.668330 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:50.669657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:50.720364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:50.741358 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1324/2658] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:50.749622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:50.749880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:50.750153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:50.769915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:50.771153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:50.779866 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1335/2659] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:50.784678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:50.796305 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dfa2f-ad09-4766-b814-db82f818f410 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:50.801261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:50.801918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:50.802197 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:50.802493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:50.803236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:26:50.803553 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:50.805233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:50.818211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1325/2660] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:26:50.825558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:50.835265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899558e4-51c2-4bdd-aab8-4e75129688fa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:50.841489 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:50.842138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:50.842440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:50.843395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:50.844456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:50.847708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:51.003569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1336/2661] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:26:50 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:26:51.008070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:51.019657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f80720-5009-4a05-9399-1838f525ce92 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:51.084568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:51.085300 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:51.085581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:51.085854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:51.087188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:51.089158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:51.177808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1326/2662] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:26:51 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:26:51.179076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:51.190623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab983e37-eeff-4bd0-9f81-b00e69e5e2b8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:51.197938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:51.198633 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:51.198896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:51.199167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:51.201183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:51.202834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:51.214520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1337/2663] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:26:51.218838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:51.229314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9d41-9956-4da7-b86c-cd662cfd9932 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:51.236669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c9b9-17a7-42aa-a9df-d19228c79482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:51.237410 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c9b9-17a7-42aa-a9df-d19228c79482 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:51.237689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c9b9-17a7-42aa-a9df-d19228c79482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:51.237962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c9b9-17a7-42aa-a9df-d19228c79482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:51.238699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754c9b9-17a7-42aa-a9df-d19228c79482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:51.240367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754c9b9-17a7-42aa-a9df-d19228c79482 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:51.253759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1327/2664] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:26:51.260386 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:51.275298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc250f1-e459-4d36-85d4-11b37d16b2e6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:51.280450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:51.288740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:51.288740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:51.288740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] PATH_INFO: `/v3/projects/78c55a1ccd79404d9939ec431206fe34/users/5c35e97635cf40f09b6441b1ad483a8a/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:51.299707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c55a1ccd79404d9939ec431206fe34, user_id=5c35e97635cf40f09b6441b1ad483a8a, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:51.302477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:51.391271 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1338/2665] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:26:51 2022] PUT /identity/v3/projects/78c55a1ccd79404d9939ec431206fe34/users/5c35e97635cf40f09b6441b1ad483a8a/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:51.402398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:51.402689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:51.402966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:51.437747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] MFA Rules not processed for user `5c35e97635cf40f09b6441b1ad483a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:26:51.439380 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:51.529204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1328/2666] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:26:51.547153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:51.547153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:51.607184 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:51.627416 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f69062-f879-4c33-8adc-23bfb8e8d140 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:51.632492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:51.633843 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:51.634130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:51.634449 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:51.645374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:51.647042 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:51.662626 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1339/2667] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:26:55.513428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:55.514983 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:55.574793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:55.597386 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e8c4-8828-4e48-a83d-dcbfcd5b0322 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:55.603002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:55.603883 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:55.604168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:55.604442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] PATH_INFO: `/v3/users/8ea97048af954a1fa0d6a3b114b43b38` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:55.605800 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea97048af954a1fa0d6a3b114b43b38)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:55.607731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:55.813519 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea97048af954a1fa0d6a3b114b43b38'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:55.814193 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea97048af954a1fa0d6a3b114b43b38'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:55.814813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea97048af954a1fa0d6a3b114b43b38'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:55.898220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea97048af954a1fa0d6a3b114b43b38'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:55.915969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea97048af954a1fa0d6a3b114b43b38'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:55.930616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1329/2668] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:55 2022] DELETE /identity/v3/users/8ea97048af954a1fa0d6a3b114b43b38 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:26:56.288896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:56.300531 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43edc1d-3d66-4049-8445-803f9fd513df service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:56.377309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:56.378875 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:56.379348 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:56.380457 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] PATH_INFO: `/v3/projects/6cfc138e921941c89c821727bc1a0a84` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:56.382727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfc138e921941c89c821727bc1a0a84)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:56.386846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:56.536439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfc138e921941c89c821727bc1a0a84', 'request_id': 'req-0b79de13-6722-43b8-b440-b8aa4570e3b2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:56.647404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfc138e921941c89c821727bc1a0a84', 'request_id': 'req-0b79de13-6722-43b8-b440-b8aa4570e3b2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:56.657857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfc138e921941c89c821727bc1a0a84', 'request_id': 'req-0b79de13-6722-43b8-b440-b8aa4570e3b2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:56.673526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] The token cache is being invalidate because project 6cfc138e921941c89c821727bc1a0a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:56.673899 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:56.674725 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:56.676538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1340/2669] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:56 2022] DELETE /identity/v3/projects/6cfc138e921941c89c821727bc1a0a84 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:56.681209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:56.682537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:56.700557 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9eff2-facd-4d87-90cc-ce233d4f6782 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:56.772063 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:56.772984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:56.773266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:56.773537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] PATH_INFO: `/v3/users/8cbd1fe5fdc248d2ab6a812295a44140` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:56.775509 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbd1fe5fdc248d2ab6a812295a44140)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:56.777513 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:57.106688 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbd1fe5fdc248d2ab6a812295a44140'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.107291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbd1fe5fdc248d2ab6a812295a44140'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.107943 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbd1fe5fdc248d2ab6a812295a44140'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.189657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbd1fe5fdc248d2ab6a812295a44140'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.198980 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:57.206139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6153b0f9-e96f-4826-a8a4-7988a8fdd6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbd1fe5fdc248d2ab6a812295a44140'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.222888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1330/2670] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:26:56 2022] DELETE /identity/v3/users/8cbd1fe5fdc248d2ab6a812295a44140 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:26:57.500142 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:26:57.501773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:26:57.519681 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79de13-6722-43b8-b440-b8aa4570e3b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:26:57.601214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:26:57.602431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:26:57.602769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:26:57.603003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] PATH_INFO: `/v3/projects/4123107639734a758094c7b9d2f2550f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:26:57.604400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4123107639734a758094c7b9d2f2550f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:26:57.606402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:26:57.624834 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:26:57.785841 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4123107639734a758094c7b9d2f2550f', 'request_id': 'req-abe14052-fc06-4260-a4b4-945311cbecc7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.875193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4123107639734a758094c7b9d2f2550f', 'request_id': 'req-abe14052-fc06-4260-a4b4-945311cbecc7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.888481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4123107639734a758094c7b9d2f2550f', 'request_id': 'req-abe14052-fc06-4260-a4b4-945311cbecc7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.899882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] The token cache is being invalidate because project 4123107639734a758094c7b9d2f2550f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:26:57.900173 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.900926 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:26:57.902719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1341/2671] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:26:57 2022] DELETE /identity/v3/projects/4123107639734a758094c7b9d2f2550f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:27:07.418209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:08.019099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:10.723024 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e6f6-9144-4dc5-b8ab-94afbebb7ff3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:10.725113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e6f6-9144-4dc5-b8ab-94afbebb7ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:10.725113 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003e6f6-9144-4dc5-b8ab-94afbebb7ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:10.744111 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e003e6f6-9144-4dc5-b8ab-94afbebb7ff3 None None] MFA Rules not processed for user `acb62f60a71c441e92f4af065df81d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:10.745377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e003e6f6-9144-4dc5-b8ab-94afbebb7ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:10.808296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1331/2672] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:20.799556 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=25 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:34.741351 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:34.743025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:34.809458 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe14052-fc06-4260-a4b4-945311cbecc7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:34.814931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:34.815812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:34.816109 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:34.816367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] PATH_INFO: `/v3/users/5c35e97635cf40f09b6441b1ad483a8a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:34.817868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c35e97635cf40f09b6441b1ad483a8a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:34.820411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:35.014895 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c35e97635cf40f09b6441b1ad483a8a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.080145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c35e97635cf40f09b6441b1ad483a8a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.080883 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c35e97635cf40f09b6441b1ad483a8a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.089590 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c35e97635cf40f09b6441b1ad483a8a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.090298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c35e97635cf40f09b6441b1ad483a8a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.109607 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1342/2673] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:27:34 2022] DELETE /identity/v3/users/5c35e97635cf40f09b6441b1ad483a8a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:27:35.114315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:35.114871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:35.114871 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:35.133850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:35.137486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:35.196512 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1332/2674] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:35.206394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:35.207807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:35.277003 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee79f2-d51a-48f0-95d3-90e3d58d175c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:35.280890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00ecc5-5c4c-4b7b-8fef-657b401d5cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:35.281573 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ecc5-5c4c-4b7b-8fef-657b401d5cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:35.281818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ecc5-5c4c-4b7b-8fef-657b401d5cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:35.282093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00ecc5-5c4c-4b7b-8fef-657b401d5cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:35.292241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ecc5-5c4c-4b7b-8fef-657b401d5cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:35.298113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00ecc5-5c4c-4b7b-8fef-657b401d5cf5 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:35.303690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1343/2675] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:27:35.762204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:35.763901 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:35.776648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82651922-64d5-4f61-96ad-f4d41cb500ec None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:35.781700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:35.782570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:35.782853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:35.783130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] PATH_INFO: `/v3/projects/78c55a1ccd79404d9939ec431206fe34` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:35.784423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c55a1ccd79404d9939ec431206fe34)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:35.786422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:35.904881 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c55a1ccd79404d9939ec431206fe34', 'request_id': 'req-e0a94873-3e69-467d-828f-d343a7b4e417'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.911231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c55a1ccd79404d9939ec431206fe34', 'request_id': 'req-e0a94873-3e69-467d-828f-d343a7b4e417'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.918594 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c55a1ccd79404d9939ec431206fe34', 'request_id': 'req-e0a94873-3e69-467d-828f-d343a7b4e417'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:35.999946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] The token cache is being invalidate because project 78c55a1ccd79404d9939ec431206fe34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:27:36.000227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:36.000903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e0a94873-3e69-467d-828f-d343a7b4e417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:36.002455 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1333/2676] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:27:35 2022] DELETE /identity/v3/projects/78c55a1ccd79404d9939ec431206fe34 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:27:36.008840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.009441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.009441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.029925 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:36.031413 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:36.050013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:36.097197 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1344/2677] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:27:36.106107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.106427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.106711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.125931 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:36.127166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:36.136167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1334/2678] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:36.143774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.158234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16d6a0-4cc9-44ab-a96c-1337f2e2d146 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.165511 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.166236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.166543 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.166812 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.167542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:27:36.167846 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.169624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.183612 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1345/2679] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:27:36.187982 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.198365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c694-db64-450b-aaeb-04ae9322d679 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.202728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.203388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.203666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.203942 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.204711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.215318 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.306167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1335/2680] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:27:36 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:27:36.310406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.320822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872667ee-8875-452a-9771-6e87b7d0789c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.377172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.377848 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.378126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.378397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.379090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.381021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.498050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1346/2681] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:27:36 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:27:36.502030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.512077 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb506e-2381-4b63-bf1a-8d5575bacaa8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.516560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.517248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.517530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.517805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.518522 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.520098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.536427 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1336/2682] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:27:36.541352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.551486 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab34bfb-d401-4716-b5c5-a701dbf45b64 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.556315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0453-251f-410d-865e-f3c632a17077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.557005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0453-251f-410d-865e-f3c632a17077 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.557290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0453-251f-410d-865e-f3c632a17077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.557565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0453-251f-410d-865e-f3c632a17077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.558286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c0453-251f-410d-865e-f3c632a17077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.559868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c0453-251f-410d-865e-f3c632a17077 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.569953 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1347/2683] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:27:36.574247 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.583932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55914ae1-27e1-47af-9099-cb3fef1de458 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.589173 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.590033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.590311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.590583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] PATH_INFO: `/v3/projects/6ccfefa0c6cb4867b2da404df1590b39/users/cd948723e27346619778eada28e45ae9/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.605659 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccfefa0c6cb4867b2da404df1590b39, user_id=cd948723e27346619778eada28e45ae9, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.608324 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.686441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1337/2684] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:27:36 2022] PUT /identity/v3/projects/6ccfefa0c6cb4867b2da404df1590b39/users/cd948723e27346619778eada28e45ae9/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:27:36.697502 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.700245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.700245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.725359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] MFA Rules not processed for user `cd948723e27346619778eada28e45ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:36.726656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:36.790431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1348/2685] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:36.801536 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.811820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:36.826492 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:36.863374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f286eae-0060-4556-aa7d-58e56a4ab09a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.867953 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37f309-5f24-4426-bbb9-69c973a36e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.868600 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f309-5f24-4426-bbb9-69c973a36e7e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.868922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f309-5f24-4426-bbb9-69c973a36e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.869200 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37f309-5f24-4426-bbb9-69c973a36e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.878429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f309-5f24-4426-bbb9-69c973a36e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.879846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37f309-5f24-4426-bbb9-69c973a36e7e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:36.889331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1338/2686] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:27:36.914274 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:36.934697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:36.978181 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfb6a3-d80a-410d-8a31-8ab3a5422429 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:36.983537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:36.984475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:36.984757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:36.985073 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] PATH_INFO: `/v3/users/cd948723e27346619778eada28e45ae9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:36.986289 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd948723e27346619778eada28e45ae9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:36.988210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:37.182265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd948723e27346619778eada28e45ae9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:37.286226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd948723e27346619778eada28e45ae9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:37.286874 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd948723e27346619778eada28e45ae9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:37.295915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd948723e27346619778eada28e45ae9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:37.296712 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd948723e27346619778eada28e45ae9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:37.318908 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1349/2687] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:27:36 2022] DELETE /identity/v3/users/cd948723e27346619778eada28e45ae9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:27:37.324956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:37.325521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:37.325521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:37.344673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:37.345999 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:37.416563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1339/2688] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:37.429057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:37.431145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:37.493188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0729a72-c8df-4898-b804-bbf646ca4eda admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:37.496913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8282d6c-3cb7-4564-b32b-f25bc06d0b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:37.497605 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282d6c-3cb7-4564-b32b-f25bc06d0b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:37.497892 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282d6c-3cb7-4564-b32b-f25bc06d0b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:37.498172 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282d6c-3cb7-4564-b32b-f25bc06d0b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:37.508258 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8282d6c-3cb7-4564-b32b-f25bc06d0b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:37.509720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8282d6c-3cb7-4564-b32b-f25bc06d0b21 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:37.519204 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1350/2689] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:27:37.978781 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:37.980223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:37.992820 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109ca90-0593-4088-921f-1aabf888e106 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:37.998149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.000528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.000528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.000528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] PATH_INFO: `/v3/projects/6ccfefa0c6cb4867b2da404df1590b39` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.001328 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccfefa0c6cb4867b2da404df1590b39)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.003564 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.086948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccfefa0c6cb4867b2da404df1590b39', 'request_id': 'req-367e886a-0790-4bbf-84af-41fe7983b8df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:38.092547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccfefa0c6cb4867b2da404df1590b39', 'request_id': 'req-367e886a-0790-4bbf-84af-41fe7983b8df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:38.098891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccfefa0c6cb4867b2da404df1590b39', 'request_id': 'req-367e886a-0790-4bbf-84af-41fe7983b8df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:38.188615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] The token cache is being invalidate because project 6ccfefa0c6cb4867b2da404df1590b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:27:38.189010 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:38.189705 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-367e886a-0790-4bbf-84af-41fe7983b8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:27:38.191461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1340/2690] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:27:37 2022] DELETE /identity/v3/projects/6ccfefa0c6cb4867b2da404df1590b39 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:27:38.197403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.197937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.197937 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.216732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:38.217961 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:38.255389 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:38.282608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1351/2691] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:38.291367 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.295201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.295201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.311693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:38.312996 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:38.321473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1341/2692] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:38.325921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:38.335747 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272971d-7f0b-450c-a146-39e65007b50c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:38.341163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.341163 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.341393 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.341663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.342385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:27:38.342692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.344287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.357492 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1352/2693] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:27:38.361985 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:38.372861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903a11b-e429-4995-89e4-43acbbbc735e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:38.377752 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.378407 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.378685 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.378957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.379679 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.381710 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.459799 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1342/2694] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:27:38 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:27:38.465675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:38.476444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399c3da-5c58-4bdb-a998-17df03148fbe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:38.540167 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.540765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.541079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.544019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.544019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.544248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.675153 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1353/2695] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:27:38 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:27:38.679837 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:38.690888 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a95bc1-58ac-4884-a82b-93e361f3ed8d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:38.696430 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.697130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.697413 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.697681 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.698403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.700027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.712073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1343/2696] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:27:38.716211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:38.728232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29207cee-c158-449b-8de3-0a0c94635d8d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:38.733363 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668e4bd-a052-484f-af03-3a797ef63f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.734043 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e4bd-a052-484f-af03-3a797ef63f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.734322 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e4bd-a052-484f-af03-3a797ef63f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.734603 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668e4bd-a052-484f-af03-3a797ef63f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.735329 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e4bd-a052-484f-af03-3a797ef63f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.737050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668e4bd-a052-484f-af03-3a797ef63f08 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.749064 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1354/2697] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:27:38.753423 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:38.765026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791d5b8-d186-4918-a1fe-6502f1ffd79f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:38.769650 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:38.770511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.770789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.771062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] PATH_INFO: `/v3/projects/0488706cc5af4af8b6cf949502dc89f4/users/2d8a3a86a60d431d97919fa85cb1a0c6/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.773576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:38.786785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0488706cc5af4af8b6cf949502dc89f4, user_id=2d8a3a86a60d431d97919fa85cb1a0c6, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:38.789608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:38.875471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1344/2698] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:27:38 2022] PUT /identity/v3/projects/0488706cc5af4af8b6cf949502dc89f4/users/2d8a3a86a60d431d97919fa85cb1a0c6/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:27:38.886976 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d69c-efaf-47e5-92d4-24b91f82ccd5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:38.887336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d69c-efaf-47e5-92d4-24b91f82ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:38.887624 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41d69c-efaf-47e5-92d4-24b91f82ccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:38.915583 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1d41d69c-efaf-47e5-92d4-24b91f82ccd5 None None] MFA Rules not processed for user `2d8a3a86a60d431d97919fa85cb1a0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:38.916972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1d41d69c-efaf-47e5-92d4-24b91f82ccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:38.986154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1355/2699] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:27:38.999307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:39.001103 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:39.066560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c23c-a5a8-4078-8b17-a4f637e39c7b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:39.070444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:39.071133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:39.071411 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:39.071694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:39.082210 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:39.083658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:39.093171 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1345/2700] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:27:40.871923 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:40.872519 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:40.872650 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:40.893610 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] MFA Rules not processed for user `2d8a3a86a60d431d97919fa85cb1a0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:27:40.894965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:40.903112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1356/2701] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:27:49.088938 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:50.887648 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:27:50.899464 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:50.902000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:50.960885 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dbdf8-87e5-478c-b46a-d45a7b0ae731 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:50.964628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:50.965296 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:50.965576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:50.965849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:50.967633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:51.043375 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:51.044838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:51.057204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1346/2702] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:27:53.410643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:53.422152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09235a9a-5487-4664-8ca8-90aeb7b251db None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:53.426320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:53.427212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:53.427440 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:53.427710 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:53.429575 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:53.445189 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:53.446622 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e22c2-f2fb-4300-ae0f-9531e53e65f5 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:53.459696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1357/2703] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:27:59.550428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:27:59.552126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:59.573015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74e25c-c9fc-461e-b155-729f11d8b026 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:27:59.579844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:27:59.580515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:27:59.580822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:27:59.581143 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:27:59.583606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:27:59.599223 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:27:59.601109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:27:59.614782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1347/2704] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:27:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:01.412580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb2e1b-d57f-41dd-961a-6d66d09875c2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:01.413331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb2e1b-d57f-41dd-961a-6d66d09875c2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:01.413331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb2e1b-d57f-41dd-961a-6d66d09875c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:01.434558 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-82eb2e1b-d57f-41dd-961a-6d66d09875c2 None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:01.435800 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-82eb2e1b-d57f-41dd-961a-6d66d09875c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:01.492807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1358/2705] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:28:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:01.650073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:01.651545 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:01.735962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7090c-de23-4036-b6c4-1314a1a832d7 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:01.740944 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:01.741583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:01.741864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:01.742134 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:01.751165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:01.752738 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:01.760841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1348/2706] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:28:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:28:02.671910 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9bab4-43af-4ab1-a8e5-7274b13ad55d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:02.672527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9bab4-43af-4ab1-a8e5-7274b13ad55d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:02.672527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9bab4-43af-4ab1-a8e5-7274b13ad55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:02.691827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34c9bab4-43af-4ab1-a8e5-7274b13ad55d None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:02.693143 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34c9bab4-43af-4ab1-a8e5-7274b13ad55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:02.701049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1359/2707] 10.222.0.71 () {58 vars in 967 bytes} [Wed May 18 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:02.721644 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:02.734810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c26f3-4721-4f8a-a4c0-5506c80954ea service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:02.740157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:02.740810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:02.741100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:02.741372 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:02.750551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:02.755964 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:02.761213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1349/2708] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:28:03.571424 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:03.571719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:03.572000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:03.590785 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:03.592004 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:03.599377 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1360/2709] 10.222.0.71 () {58 vars in 1009 bytes} [Wed May 18 14:28:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:03.613872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:03.621314 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:03.627620 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309120d-3982-4c73-bd24-77dd29656857 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:03.634124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814484f-b6b9-42d6-98fb-b44ff6db4d13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:03.635219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814484f-b6b9-42d6-98fb-b44ff6db4d13 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:03.635740 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814484f-b6b9-42d6-98fb-b44ff6db4d13 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:03.636254 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814484f-b6b9-42d6-98fb-b44ff6db4d13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:03.649747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814484f-b6b9-42d6-98fb-b44ff6db4d13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:03.651248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814484f-b6b9-42d6-98fb-b44ff6db4d13 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:03.660498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1350/2710] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:28:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:28:03.910253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:03.911801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:03.924708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765e6e-f192-4b4c-b403-8e9e76b76daf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:03.928246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:03.928929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:03.929212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:03.929490 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:03.931265 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:03.997694 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:03.999211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:04.010252 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1361/2711] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:04.459577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:04.460333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:04.460333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:04.479821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] MFA Rules not processed for user `7881b24eb9e740bb8c74d3e1b2be9428`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:04.481810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:04.489514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1351/2712] 10.222.0.71 () {58 vars in 967 bytes} [Wed May 18 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:04.502946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:04.515801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8205c2-4bf0-4dd3-a813-79f94d159fda service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:04.520759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb52faf-fd77-4610-916b-306c189fc30f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fdd10e85dd44e9a952b25557a8236f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:04.521441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb52faf-fd77-4610-916b-306c189fc30f service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:04.521724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb52faf-fd77-4610-916b-306c189fc30f service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:04.521999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb52faf-fd77-4610-916b-306c189fc30f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:04.532340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb52faf-fd77-4610-916b-306c189fc30f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:04.533997 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb52faf-fd77-4610-916b-306c189fc30f service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:04.543088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1362/2713] 10.222.0.71 () {60 vars in 1384 bytes} [Wed May 18 14:28:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 14:28:07.605852 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:07.620122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2b70c-e4ee-4357-b3e9-1005a57bee2b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:07.625653 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:07.626535 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:07.626819 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:07.627101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] PATH_INFO: `/v3/users/2d8a3a86a60d431d97919fa85cb1a0c6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:07.628331 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8a3a86a60d431d97919fa85cb1a0c6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:07.630311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:07.916886 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8a3a86a60d431d97919fa85cb1a0c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:07.917747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8a3a86a60d431d97919fa85cb1a0c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:07.919541 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8a3a86a60d431d97919fa85cb1a0c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.022599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8a3a86a60d431d97919fa85cb1a0c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.037224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8a3a86a60d431d97919fa85cb1a0c6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.051593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1352/2714] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:28:07 2022] DELETE /identity/v3/users/2d8a3a86a60d431d97919fa85cb1a0c6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:08.056370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:08.056891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:08.056891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:08.075915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:08.077579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:08.133022 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:08.148093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1363/2715] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:28:08.165422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:08.165422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:08.225606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5c014-8e22-42c9-9f86-494a1d67775a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:08.229440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba59db-d37a-40b7-af17-74314b59171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:08.230130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba59db-d37a-40b7-af17-74314b59171a service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:08.231201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba59db-d37a-40b7-af17-74314b59171a service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:08.231493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba59db-d37a-40b7-af17-74314b59171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:08.243504 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba59db-d37a-40b7-af17-74314b59171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:08.245000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba59db-d37a-40b7-af17-74314b59171a service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:08.255984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1353/2716] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:08.608500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:08.616216 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:08.627577 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47300c7-bc24-4592-9914-48470daa97cd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:08.633152 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:08.634140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:08.634542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:08.634822 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] PATH_INFO: `/v3/projects/0488706cc5af4af8b6cf949502dc89f4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:08.636072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0488706cc5af4af8b6cf949502dc89f4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:08.638708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:08.781952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0488706cc5af4af8b6cf949502dc89f4', 'request_id': 'req-d9fd64c7-0326-498b-afc6-8c940fa30ac5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.852988 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0488706cc5af4af8b6cf949502dc89f4', 'request_id': 'req-d9fd64c7-0326-498b-afc6-8c940fa30ac5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.863009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0488706cc5af4af8b6cf949502dc89f4', 'request_id': 'req-d9fd64c7-0326-498b-afc6-8c940fa30ac5'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.879873 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] The token cache is being invalidate because project 0488706cc5af4af8b6cf949502dc89f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:28:08.880320 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.881034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d9fd64c7-0326-498b-afc6-8c940fa30ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:08.882601 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1364/2717] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:28:08 2022] DELETE /identity/v3/projects/0488706cc5af4af8b6cf949502dc89f4 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:08.888669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:08.889273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:08.889534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:08.909196 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:08.910646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:08.969302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:08.979432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1354/2718] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:28:08.988304 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351f84-af60-46ad-b32c-940568b50509 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:08.988595 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351f84-af60-46ad-b32c-940568b50509 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:08.988962 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44351f84-af60-46ad-b32c-940568b50509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.012517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-44351f84-af60-46ad-b32c-940568b50509 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:09.013881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-44351f84-af60-46ad-b32c-940568b50509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:09.025613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1365/2719] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:09.035325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.045018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd13931-50b1-4288-9d00-cb80d936bfb2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.050096 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.050891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.051554 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.051889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.052619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:28:09.052967 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.054577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.066147 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1355/2720] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:28:09.070845 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44351f84-af60-46ad-b32c-940568b50509 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.081195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44351f84-af60-46ad-b32c-940568b50509 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.085979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.089733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.089733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.089733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.089733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.090827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.225469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1366/2721] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:28:09 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:28:09.233510 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.249288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ddb0-ec43-48a8-8f9f-a63fb74f5cad admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.323962 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.331150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.331150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.331150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.331150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.331150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.499766 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1356/2722] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:28:09 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:28:09.503542 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.515678 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e246d8-5872-48dc-bc2d-c960a3ee493c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.520387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.521100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.521376 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.521647 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.522408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.524062 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.538651 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1367/2723] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:28:09.539992 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.550209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3e03c-28a1-4eeb-a69e-7bdf8cb1e0b1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.555022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6897f-a37b-48cd-9e9e-77c9c926e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.555691 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6897f-a37b-48cd-9e9e-77c9c926e384 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.555974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6897f-a37b-48cd-9e9e-77c9c926e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.556251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6897f-a37b-48cd-9e9e-77c9c926e384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.557020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6897f-a37b-48cd-9e9e-77c9c926e384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.559192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6897f-a37b-48cd-9e9e-77c9c926e384 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.570090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1357/2724] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:28:09.575009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.585226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bc73-e094-4dbf-b7ff-6989238b8226 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.590161 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.591050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.591332 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.591608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] PATH_INFO: `/v3/projects/dd4e2f9843b84aebb963f491048a331a/users/5f0656b31b5f4cbd8912b1a0aba928cc/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.608033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4e2f9843b84aebb963f491048a331a, user_id=5f0656b31b5f4cbd8912b1a0aba928cc, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.610723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.713437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1368/2725] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:28:09 2022] PUT /identity/v3/projects/dd4e2f9843b84aebb963f491048a331a/users/5f0656b31b5f4cbd8912b1a0aba928cc/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:28:09.718829 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.719369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.719726 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.763956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:09.765267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:09.841351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1358/2726] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:28:09.850915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:09.853510 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:09.926294 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f4d2e-c73a-4f5b-8dda-54ca970527e7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:09.930264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:09.930938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:09.931222 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:09.932526 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:09.944218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:09.945891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:09.957566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1369/2727] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:12.328157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:12.330050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:12.345981 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d616-1920-4604-8556-b32db8f34032 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:12.351484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:12.352517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:12.359447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:12.359823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] PATH_INFO: `/v3/users/4b79ded3ff9146948803b1e63994a225` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:12.361421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b79ded3ff9146948803b1e63994a225)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:12.363387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:12.629573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b79ded3ff9146948803b1e63994a225'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:12.637976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b79ded3ff9146948803b1e63994a225'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:12.638873 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b79ded3ff9146948803b1e63994a225'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:12.784567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b79ded3ff9146948803b1e63994a225'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:12.796248 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:12.815286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b79ded3ff9146948803b1e63994a225'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:12.830354 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1359/2728] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:28:12 2022] DELETE /identity/v3/users/4b79ded3ff9146948803b1e63994a225 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:13.132741 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:13.146764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06470b3a-3e6b-42bc-af7f-f69d01fbd9b8 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:13.171165 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:13.213707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:13.214713 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:13.215087 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:13.215475 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] PATH_INFO: `/v3/projects/40663a63d8dc4922879421a0c7d0c0a7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:13.216922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40663a63d8dc4922879421a0c7d0c0a7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:13.218891 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:13.348922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40663a63d8dc4922879421a0c7d0c0a7', 'request_id': 'req-e1baba71-23d8-4acd-8c27-19c81547152a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.467200 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40663a63d8dc4922879421a0c7d0c0a7', 'request_id': 'req-e1baba71-23d8-4acd-8c27-19c81547152a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.473886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40663a63d8dc4922879421a0c7d0c0a7', 'request_id': 'req-e1baba71-23d8-4acd-8c27-19c81547152a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.486463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] The token cache is being invalidate because project 40663a63d8dc4922879421a0c7d0c0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:28:13.486754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.487429 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.489067 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1370/2729] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:28:13 2022] DELETE /identity/v3/projects/40663a63d8dc4922879421a0c7d0c0a7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:13.493152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:13.494666 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:13.510333 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe8682-ea30-4bce-a10a-8f8fc77b2e15 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:13.585578 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:13.586475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:13.586748 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:13.587025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] PATH_INFO: `/v3/users/2b018b60cc0245f3bc303cace138a050` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:13.588221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b018b60cc0245f3bc303cace138a050)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:13.590906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:13.823562 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b018b60cc0245f3bc303cace138a050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.825026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b018b60cc0245f3bc303cace138a050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.825818 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b018b60cc0245f3bc303cace138a050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.892050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b018b60cc0245f3bc303cace138a050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.913294 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ae1f2305-9f67-4cce-9ffd-beb3f1437ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b018b60cc0245f3bc303cace138a050'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:13.934362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1360/2730] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:28:13 2022] DELETE /identity/v3/users/2b018b60cc0245f3bc303cace138a050 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:14.278485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:14.281437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:14.297019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1baba71-23d8-4acd-8c27-19c81547152a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:14.397984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:14.400035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:14.400906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:14.401819 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] PATH_INFO: `/v3/projects/e15c5252b2014b189dd35e3adfa68206` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:14.407051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15c5252b2014b189dd35e3adfa68206)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:14.410374 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:14.597900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15c5252b2014b189dd35e3adfa68206', 'request_id': 'req-3df6b3da-449b-4692-8907-be04e4670d58'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:14.601966 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:14.679956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15c5252b2014b189dd35e3adfa68206', 'request_id': 'req-3df6b3da-449b-4692-8907-be04e4670d58'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:14.686979 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15c5252b2014b189dd35e3adfa68206', 'request_id': 'req-3df6b3da-449b-4692-8907-be04e4670d58'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:14.701381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] The token cache is being invalidate because project e15c5252b2014b189dd35e3adfa68206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:28:14.701663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:14.702327 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:28:14.704195 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1371/2731] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:28:14 2022] DELETE /identity/v3/projects/e15c5252b2014b189dd35e3adfa68206 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:16.343265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:16.343265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:16.343265 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:16.375669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] MFA Rules not processed for user `5f0656b31b5f4cbd8912b1a0aba928cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:16.378966 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:16.450612 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:16.481499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1361/2732] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:16.486277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:16.488334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:16.557210 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6b3da-449b-4692-8907-be04e4670d58 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:16.562711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:16.563382 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:16.563665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:16.563943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:16.564634 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:16.566565 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:16.646649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1372/2733] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:28:16 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:28:16.650782 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:16.662130 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f88bf5-29de-4d27-91a6-74f1f1b79fb0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:16.718733 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:16.719325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:16.719609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:16.719890 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:16.720590 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:16.722585 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:16.800835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1362/2734] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:28:16 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:28:16.804825 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:16.816005 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175abb70-30a8-4239-a29a-c77bcf7c945c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:16.823381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:16.826094 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:16.826368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:16.826661 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:16.827387 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:16.829011 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:16.841360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1373/2735] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:28:16.845993 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:16.858074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874371e4-b72b-4848-8752-012e92fa2d5f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:16.863205 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:16.864263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:16.864549 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:16.864861 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] PATH_INFO: `/v3/projects/cf2664cbad244f59861042b2060d3d59/users/59ba98f0d10543c8814b249c5e53ab35/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:16.882906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2664cbad244f59861042b2060d3d59, user_id=59ba98f0d10543c8814b249c5e53ab35, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:16.885703 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:16.988524 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1363/2736] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:28:16 2022] PUT /identity/v3/projects/cf2664cbad244f59861042b2060d3d59/users/59ba98f0d10543c8814b249c5e53ab35/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:28:16.992645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:17.002587 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22663c-cc81-4ce8-a3d5-190b4708b437 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:17.060914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c497ea-00ce-407c-a450-b9d07efa231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:17.061569 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c497ea-00ce-407c-a450-b9d07efa231d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:17.061842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c497ea-00ce-407c-a450-b9d07efa231d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:17.062115 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c497ea-00ce-407c-a450-b9d07efa231d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:17.062830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c497ea-00ce-407c-a450-b9d07efa231d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:17.064432 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c497ea-00ce-407c-a450-b9d07efa231d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:17.075459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1374/2737] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:28:17.079582 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:17.092045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b369043-d573-48da-a969-240058010ff3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:17.097195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:17.098227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:17.098505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:17.098778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] PATH_INFO: `/v3/projects/cf2664cbad244f59861042b2060d3d59/users/59ba98f0d10543c8814b249c5e53ab35/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:17.101021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2664cbad244f59861042b2060d3d59, user_id=59ba98f0d10543c8814b249c5e53ab35, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:17.103805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:17.116042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1364/2738] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:28:17 2022] PUT /identity/v3/projects/cf2664cbad244f59861042b2060d3d59/users/59ba98f0d10543c8814b249c5e53ab35/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:28:23.834336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa7762-a77c-423b-af9f-843e1f6ccb1d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:23.834336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa7762-a77c-423b-af9f-843e1f6ccb1d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:23.834336 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa7762-a77c-423b-af9f-843e1f6ccb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:23.888837 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e8fa7762-a77c-423b-af9f-843e1f6ccb1d None None] MFA Rules not processed for user `59ba98f0d10543c8814b249c5e53ab35`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:23.890217 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e8fa7762-a77c-423b-af9f-843e1f6ccb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:23.941034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:23.978735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1375/2739] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:23.994313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:23.996280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:24.093450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135694c1-cd13-401f-85bf-efa3257b7c6c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:24.101896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68fe09-7158-4625-a3d1-93291eb7fdfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:24.102563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68fe09-7158-4625-a3d1-93291eb7fdfd service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:24.102841 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68fe09-7158-4625-a3d1-93291eb7fdfd service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:24.103114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68fe09-7158-4625-a3d1-93291eb7fdfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:24.144970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:24.171290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68fe09-7158-4625-a3d1-93291eb7fdfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:24.173045 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68fe09-7158-4625-a3d1-93291eb7fdfd service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:24.182793 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1365/2740] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:27.447345 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:27.447838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:27.447967 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:27.469722 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] MFA Rules not processed for user `5f0656b31b5f4cbd8912b1a0aba928cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:27.471212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:27.478886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1376/2741] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:27.791090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:27.791656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:27.791656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:27.818611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] MFA Rules not processed for user `acb62f60a71c441e92f4af065df81d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:28:27.819845 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:27.895847 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1366/2742] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:28:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:28:28.236372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:28.238151 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:28.299069 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73066d06-90d6-4199-813f-f98dcc52b714 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:28.302730 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:28.303381 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:28.303684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:28.303939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:28.305754 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:28.316470 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:28.317960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:28.326801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1377/2743] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:28.754988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:28.758959 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:28.837665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551bcb-a00f-48bd-8554-742763910a9e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:28.842884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:28.843699 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:28.843988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:28.844255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:28.846112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:28.858473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:28.860089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:28.874050 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1367/2744] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:32.195402 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:32.197890 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:32.211050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c85f-e796-4bea-a9ae-9583a96ee1ac service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:32.216408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:32.216408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:32.216408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:32.216408 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:32.229480 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:32.256735 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:32.258196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:32.281975 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1378/2745] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:38.866449 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=68 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:39.682667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:39.727267 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10ec75-2cb3-4361-9559-1de7f39c8d08 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:39.733392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:39.734053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:39.734340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:39.734615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:39.736483 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:39.772338 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:39.774005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:39.787082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1368/2746] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:42.272176 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=45 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:44.613257 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:28:44.658118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c445-5c2f-4ac6-84da-e1f8e203f7a5 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:28:44.662030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:28:44.662684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:28:44.662963 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:28:44.663234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:28:44.665125 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:28:44.693952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:28:44.695693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:28:44.709422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1379/2747] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:28:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:28:49.782397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=28 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:28:54.705346 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=23 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:04.443729 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:04.453586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a61c-fb0d-49b6-a9e1-4ec392193a6d service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:04.457774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:04.458429 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:04.458715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:04.458989 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:04.468814 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:04.470428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:04.480502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1369/2748] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:14.481772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:20.262212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:20.296219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f1ca-af2a-4980-8348-21cc758f2034 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:20.302060 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:20.302847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:20.303133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:20.303409 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:20.305292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:20.316426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:20.318341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:20.328098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1380/2749] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:30.323469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=13 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:42.868592 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:42.877349 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9de2f-9562-48fc-b77b-98869a78d1ef service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:42.881916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:42.882570 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:42.882851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:42.883160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:42.885343 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:42.972299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:42.973764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:42.993374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1370/2750] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:46.857379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:46.859364 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:46.874534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68110e9-5a23-449c-9d0e-d5c5c48e2e01 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:46.879455 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:46.880354 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:46.880682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:46.880996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] PATH_INFO: `/v3/users/acb62f60a71c441e92f4af065df81d4b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:46.886646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb62f60a71c441e92f4af065df81d4b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:46.886646 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:47.113232 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb62f60a71c441e92f4af065df81d4b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.181032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb62f60a71c441e92f4af065df81d4b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.181995 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb62f60a71c441e92f4af065df81d4b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.190358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb62f60a71c441e92f4af065df81d4b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.195900 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b13187fb-d73f-4544-922f-55556579c9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb62f60a71c441e92f4af065df81d4b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.209700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1381/2751] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:29:46 2022] DELETE /identity/v3/users/acb62f60a71c441e92f4af065df81d4b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:47.445030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:47.456155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eff84b-b63e-456d-a83e-f02b31a0f384 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:47.518474 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:47.519320 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:47.519601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:47.519880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] PATH_INFO: `/v3/projects/1bf771dcc9ca4e00914c6791c30e3b6e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:47.521100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf771dcc9ca4e00914c6791c30e3b6e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:47.523011 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:47.634266 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf771dcc9ca4e00914c6791c30e3b6e', 'request_id': 'req-15134a18-cc8a-46e6-8ccd-61226cba6dec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.640396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf771dcc9ca4e00914c6791c30e3b6e', 'request_id': 'req-15134a18-cc8a-46e6-8ccd-61226cba6dec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.647241 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf771dcc9ca4e00914c6791c30e3b6e', 'request_id': 'req-15134a18-cc8a-46e6-8ccd-61226cba6dec'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.652068 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:47.735211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] The token cache is being invalidate because project 1bf771dcc9ca4e00914c6791c30e3b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:29:47.735442 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.736065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-15134a18-cc8a-46e6-8ccd-61226cba6dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:47.737641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1371/2752] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:29:47 2022] DELETE /identity/v3/projects/1bf771dcc9ca4e00914c6791c30e3b6e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:47.742682 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:47.742970 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:47.743341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:47.803238 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:47.804487 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:47.870208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1382/2753] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:47.878727 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:47.879018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:47.879301 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:47.898746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:47.900224 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:47.909550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1372/2754] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:47.913893 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:47.924030 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e6ef-2990-4ab4-9904-de94e22828ff None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:47.928905 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:47.929564 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:47.929844 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:47.930114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:47.931538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:29:47.931959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:47.933580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:47.946039 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1383/2755] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 14:29:47.951132 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:47.960397 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa829208-5a53-401b-8d79-0fce34ca4a69 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:47.965327 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:47.965979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:47.966262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:47.966534 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:47.967234 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:47.969168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:48.075271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1373/2756] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:29:47 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:29:48.079437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:48.090341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcafb66-210c-470d-adfc-c572641b2ee6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:48.117028 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:48.151301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:48.152040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.152315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.152598 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.153341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:48.155313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:48.251085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1384/2757] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:29:48 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:48.255145 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:48.266418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf91e-bfd7-410f-a79b-1fc8c1cecc91 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:48.271129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:48.271796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.272082 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.272360 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.273139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:48.275400 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:48.286916 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1374/2758] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:48.291523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:48.303221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ef20-c642-41e7-95e7-f7a32785c7d0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:48.308863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc671d-1800-4576-8ef2-764ffb5a29d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:48.309540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc671d-1800-4576-8ef2-764ffb5a29d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.309831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc671d-1800-4576-8ef2-764ffb5a29d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.310105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc671d-1800-4576-8ef2-764ffb5a29d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.310833 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc671d-1800-4576-8ef2-764ffb5a29d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:48.312444 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc671d-1800-4576-8ef2-764ffb5a29d2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:48.323985 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1385/2759] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:48.330166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:48.341382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e67fe-2ada-4448-9f92-a0d7d9d4073f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:48.346340 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:48.347378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.347654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.347925 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] PATH_INFO: `/v3/projects/f226ab6f6cbb4d8492a935148cd4a6a4/users/252136d9caac40d697e5d0cc91efde55/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.362669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f226ab6f6cbb4d8492a935148cd4a6a4, user_id=252136d9caac40d697e5d0cc91efde55, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:48.365697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:48.461859 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1375/2760] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:48 2022] PUT /identity/v3/projects/f226ab6f6cbb4d8492a935148cd4a6a4/users/252136d9caac40d697e5d0cc91efde55/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:48.472360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.472660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.473123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.503080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] MFA Rules not processed for user `252136d9caac40d697e5d0cc91efde55`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:48.504315 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:48.576840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1386/2761] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:48.585366 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:48.657313 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8bc26f-8463-4cc1-8039-e8f55d58a781 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:48.662039 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:48.667895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.667895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.667895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.667895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:48.667895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:48.770014 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1376/2762] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:29:48 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:48.774324 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:48.785746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a03c61-5b5f-469a-b36e-a1012d38ff82 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:48.854052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:48.854649 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:48.854934 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:48.855213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:48.855918 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:48.857917 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.011287 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1387/2763] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:29:48 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:49.015577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:49.028895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45653873-e7a1-4ccb-bf91-9f3e46ae3b39 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:49.034101 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:49.034927 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.035062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.035322 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.036065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:49.037789 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.050506 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1377/2764] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:49.055317 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:49.066830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c2de-8f51-4b4f-bdb0-f6f00f9debef admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:49.072769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:49.073728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.074009 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.074290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] PATH_INFO: `/v3/projects/aa8072c0ca3045df9675c172417519da/users/fc7fe63d4cc1439586bc0874852fc72b/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.093312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8072c0ca3045df9675c172417519da, user_id=fc7fe63d4cc1439586bc0874852fc72b, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:49.096072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.176053 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1388/2765] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:49 2022] PUT /identity/v3/projects/aa8072c0ca3045df9675c172417519da/users/fc7fe63d4cc1439586bc0874852fc72b/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:49.180461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:49.191822 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01267c-a554-4afe-83f0-da5c9a93f0e2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:49.254073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea99caa-a886-4a24-a551-7027c37bb5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:49.254796 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea99caa-a886-4a24-a551-7027c37bb5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.255062 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea99caa-a886-4a24-a551-7027c37bb5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.255393 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea99caa-a886-4a24-a551-7027c37bb5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.256125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea99caa-a886-4a24-a551-7027c37bb5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:49.257821 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea99caa-a886-4a24-a551-7027c37bb5b4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.268893 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1378/2766] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:29:49.273110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:49.278629 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:49.284051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaec8d2-5aeb-4761-b5b5-40fee314ec93 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:49.288724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:49.289691 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.289973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.290243 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] PATH_INFO: `/v3/projects/aa8072c0ca3045df9675c172417519da/users/fc7fe63d4cc1439586bc0874852fc72b/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.293255 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8072c0ca3045df9675c172417519da, user_id=fc7fe63d4cc1439586bc0874852fc72b, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:49.295886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.307673 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1389/2767] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:49 2022] PUT /identity/v3/projects/aa8072c0ca3045df9675c172417519da/users/fc7fe63d4cc1439586bc0874852fc72b/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:49.318204 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.318493 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.318775 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.325095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:49.347443 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] MFA Rules not processed for user `fc7fe63d4cc1439586bc0874852fc72b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:49.348669 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:49.420121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1379/2768] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:49.431586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:49.433264 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:49.639936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735569-6db0-41de-857d-f70efbe38f89 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:49.643562 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:49.644234 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.644501 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.644768 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.654720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:49.656426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.666954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1390/2769] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:49 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:49.769290 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:49.770746 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:49.788220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491b6ea-5a97-4ca8-a4bd-0e1ab0c90e9c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:49.788220 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d52f-ec17-42a3-b161-af5779fca1ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:49.788441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d52f-ec17-42a3-b161-af5779fca1ba service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:49.788588 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d52f-ec17-42a3-b161-af5779fca1ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:49.788896 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d52f-ec17-42a3-b161-af5779fca1ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:49.848547 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d52f-ec17-42a3-b161-af5779fca1ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:49.850021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d52f-ec17-42a3-b161-af5779fca1ba service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:49.859468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1380/2770] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:54.669896 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:54.733428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c938f-536d-4a32-9692-49ad36c532e1 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:54.738114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:54.738978 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:54.739262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:54.739541 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] PATH_INFO: `/v3/users/252136d9caac40d697e5d0cc91efde55` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:54.740719 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252136d9caac40d697e5d0cc91efde55)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:54.742669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:54.962507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252136d9caac40d697e5d0cc91efde55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.035861 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252136d9caac40d697e5d0cc91efde55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.036434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252136d9caac40d697e5d0cc91efde55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.044739 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252136d9caac40d697e5d0cc91efde55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.045426 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252136d9caac40d697e5d0cc91efde55'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.053566 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:55.063680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1391/2771] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:29:54 2022] DELETE /identity/v3/users/252136d9caac40d697e5d0cc91efde55 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:29:55.068212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:55.068802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:55.068802 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:55.087083 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:55.089075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:55.149072 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1381/2772] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:55.159982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:55.165976 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:55.223948 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955cf1-0837-4961-a3f9-86781219c2c3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:55.227520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:55.228168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:55.228445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:55.229341 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:55.238839 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:55.240260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:55.250561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1392/2773] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:55.680364 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:55.681424 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:55.694998 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ffea9-7a0f-451f-b642-da9b4d90cb86 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:55.701396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:55.702269 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:55.702550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:55.702823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] PATH_INFO: `/v3/projects/f226ab6f6cbb4d8492a935148cd4a6a4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:55.704067 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f226ab6f6cbb4d8492a935148cd4a6a4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:55.706179 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:55.732971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:55.841219 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f226ab6f6cbb4d8492a935148cd4a6a4', 'request_id': 'req-ef2b893a-9bdb-4109-840a-72a9acebbae6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.846619 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f226ab6f6cbb4d8492a935148cd4a6a4', 'request_id': 'req-ef2b893a-9bdb-4109-840a-72a9acebbae6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.853140 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f226ab6f6cbb4d8492a935148cd4a6a4', 'request_id': 'req-ef2b893a-9bdb-4109-840a-72a9acebbae6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.957092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] The token cache is being invalidate because project f226ab6f6cbb4d8492a935148cd4a6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:29:55.957319 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.957928 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:55.959599 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1382/2774] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:29:55 2022] DELETE /identity/v3/projects/f226ab6f6cbb4d8492a935148cd4a6a4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:55.964684 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:55.974688 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171e391-199c-4d85-98a5-fe99533281a3 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:56.034110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:56.034969 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:56.035246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:56.035517 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] PATH_INFO: `/v3/users/fc7fe63d4cc1439586bc0874852fc72b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:56.036692 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7fe63d4cc1439586bc0874852fc72b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:56.038620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:56.278947 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7fe63d4cc1439586bc0874852fc72b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:56.380553 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7fe63d4cc1439586bc0874852fc72b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:56.383791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7fe63d4cc1439586bc0874852fc72b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:56.389726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7fe63d4cc1439586bc0874852fc72b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:56.390504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3a70764c-c0f7-4c02-b700-9d68ace78c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7fe63d4cc1439586bc0874852fc72b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:56.408604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1393/2775] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:29:55 2022] DELETE /identity/v3/users/fc7fe63d4cc1439586bc0874852fc72b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:56.925929 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:56.927514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:56.946133 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b893a-9bdb-4109-840a-72a9acebbae6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.006974 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.007838 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.008124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.008396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] PATH_INFO: `/v3/projects/aa8072c0ca3045df9675c172417519da` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.009689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8072c0ca3045df9675c172417519da)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.011638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.118692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8072c0ca3045df9675c172417519da', 'request_id': 'req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:57.124256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8072c0ca3045df9675c172417519da', 'request_id': 'req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:57.130609 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8072c0ca3045df9675c172417519da', 'request_id': 'req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:57.225865 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] The token cache is being invalidate because project aa8072c0ca3045df9675c172417519da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:29:57.226148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:57.226779 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2fca93fe-8bdc-4353-b0c6-e98f3d41c58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:29:57.228623 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1383/2776] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:29:56 2022] DELETE /identity/v3/projects/aa8072c0ca3045df9675c172417519da => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:57.233632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.238791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.238791 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.254013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:57.255214 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:57.265608 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:57.318442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1394/2777] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:57.326973 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.327255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.327531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.346657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:57.347926 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:57.357373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1384/2778] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:57.361675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:57.372456 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44479ad-e4c2-464d-b6dd-343f23ed0c06 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.377086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.377751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.378031 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.378312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.379056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:29:57.379360 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.380981 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.393887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1395/2779] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:29:57.398227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:57.409221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594893f-1523-498f-98fe-f32c7a82ddcf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.414075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.414725 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.415001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.415273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.415948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.419155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.548979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1385/2780] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:29:57 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:57.553602 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:57.565617 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0c55e-11ea-406d-8bf7-849c536501df admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.623840 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.624404 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.624686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.625007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.625686 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.627591 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.764756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1396/2781] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:29:57 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:57.768975 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:57.779895 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb258e-bd50-412a-8ea2-db540dea8c5e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.784971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.785635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.785908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.786199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.787499 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.788677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.794404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:57.800213 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1386/2782] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:57.808606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:57.819123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a2e27-9063-408d-b8b8-adf4918f6335 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.824863 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4ac8e-c9c5-4f70-8b35-174688459abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.825528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ac8e-c9c5-4f70-8b35-174688459abf admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.825803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ac8e-c9c5-4f70-8b35-174688459abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.826072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ac8e-c9c5-4f70-8b35-174688459abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.826798 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4ac8e-c9c5-4f70-8b35-174688459abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.828379 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4ac8e-c9c5-4f70-8b35-174688459abf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.839088 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1397/2783] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:57.848857 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:57.859342 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab32960-55ca-4197-a7c9-e59022051ee4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:57.863970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:57.864891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.865170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.865439 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] PATH_INFO: `/v3/projects/9ae9786e7b7f46b0a87bdb15b58bf4f8/users/3c0cc25fea6e4c3db85bc1b51d13eaef/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:57.882858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae9786e7b7f46b0a87bdb15b58bf4f8, user_id=3c0cc25fea6e4c3db85bc1b51d13eaef, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:57.884121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:57.969571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1387/2784] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:57 2022] PUT /identity/v3/projects/9ae9786e7b7f46b0a87bdb15b58bf4f8/users/3c0cc25fea6e4c3db85bc1b51d13eaef/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:57.980943 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:57.981230 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:57.981507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.011236 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] MFA Rules not processed for user `3c0cc25fea6e4c3db85bc1b51d13eaef`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:58.012466 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:58.079717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1398/2785] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:58.084348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.148156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ae0a-91d9-48bc-b867-130701005db4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:58.153075 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:58.153734 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.154013 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.154285 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.155005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:58.157243 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:58.262262 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1388/2786] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:29:58 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:58.266516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.277670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c6960-81d7-4cf4-9052-b2fa4c73eb1b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:58.282770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:58.334954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:58.335632 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.335916 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.336188 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.336897 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:58.339438 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:58.450534 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1399/2787] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:29:58 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:58.454671 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.465125 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b5530-7c03-4bf0-8842-dc6027f01bf0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:58.469747 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:58.470403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.470683 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.470956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.471675 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:58.473315 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:58.485053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1389/2788] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:58.492936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.504249 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953219-95ea-49a3-9f8c-7aa655fa4658 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:58.509385 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e64533-5e5d-49e3-89a5-1fd12bd9b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:58.510886 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64533-5e5d-49e3-89a5-1fd12bd9b8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.511168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64533-5e5d-49e3-89a5-1fd12bd9b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.511442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64533-5e5d-49e3-89a5-1fd12bd9b8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.512166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e64533-5e5d-49e3-89a5-1fd12bd9b8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:58.513778 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e64533-5e5d-49e3-89a5-1fd12bd9b8d0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:58.524277 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1400/2789] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:58.529127 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.539390 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275ec3-8873-40b6-876a-f8d1501d6dd5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:58.544486 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:58.545404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.545677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.545952 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] PATH_INFO: `/v3/projects/a7e49e7df22f42a5b183e86d050520ee/users/61fc5b07175e411d8e83f2281e689263/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.562276 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e49e7df22f42a5b183e86d050520ee, user_id=61fc5b07175e411d8e83f2281e689263, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:58.565018 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:58.653583 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1390/2790] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:58 2022] PUT /identity/v3/projects/a7e49e7df22f42a5b183e86d050520ee/users/61fc5b07175e411d8e83f2281e689263/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:58.666052 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.666349 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.666628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.694724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] MFA Rules not processed for user `61fc5b07175e411d8e83f2281e689263`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:58.695939 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:58.766801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1401/2791] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:58.771149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.834976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5334b6-ff1b-48cf-9b0c-9eba122257c3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:58.839844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:58.840539 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:58.840854 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:58.841135 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:58.841824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:58.843862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:58.930692 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1391/2792] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:29:58 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:58.936343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:58.949183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc5d0-af1b-40e3-9f08-81676ee01bc6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.011107 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.011826 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.012108 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.012384 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.013138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.015098 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.105968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1402/2793] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:29:58 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:29:59.110589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:59.121719 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c062e-4790-4945-a21e-191c73f5340d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.126326 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.126979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.127257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.127530 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.128251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.129970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.135835 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:59.142665 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1392/2794] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:59.146996 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:59.158288 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c416d-5c20-47da-a7ad-d4269302ce81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.169498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.169498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.169498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.169498 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] PATH_INFO: `/v3/projects/b87069a87fde4aefadb83fc6e23bd55d/users/8db70a40bbcc44c19d5983d4eae5f08d/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.169930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:29:59.182309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87069a87fde4aefadb83fc6e23bd55d, user_id=8db70a40bbcc44c19d5983d4eae5f08d, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.185310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.262086 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1403/2795] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:59 2022] PUT /identity/v3/projects/b87069a87fde4aefadb83fc6e23bd55d/users/8db70a40bbcc44c19d5983d4eae5f08d/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:59.266172 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:59.276495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c034578-8cc6-4148-9db5-23f9de34e8eb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.333633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67657db0-1ac7-4b7f-9905-863059d09a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.334306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657db0-1ac7-4b7f-9905-863059d09a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.334718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657db0-1ac7-4b7f-9905-863059d09a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.335000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67657db0-1ac7-4b7f-9905-863059d09a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.335728 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657db0-1ac7-4b7f-9905-863059d09a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.337362 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67657db0-1ac7-4b7f-9905-863059d09a2c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.347803 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1393/2796] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:29:59.352082 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:59.362358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b753ca-757d-456a-be5a-7c7888aee9e8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.366955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.367824 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.368145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.368359 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] PATH_INFO: `/v3/projects/b87069a87fde4aefadb83fc6e23bd55d/users/8db70a40bbcc44c19d5983d4eae5f08d/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.370931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87069a87fde4aefadb83fc6e23bd55d, user_id=8db70a40bbcc44c19d5983d4eae5f08d, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.373726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.384439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1404/2797] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:29:59 2022] PUT /identity/v3/projects/b87069a87fde4aefadb83fc6e23bd55d/users/8db70a40bbcc44c19d5983d4eae5f08d/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:29:59.395648 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.395940 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.396221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.424392 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] MFA Rules not processed for user `8db70a40bbcc44c19d5983d4eae5f08d`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:29:59.425707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:59.495131 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1394/2798] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:29:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:29:59.507251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:59.508955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:59.567442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63987c-db04-427f-9640-39a295f54c41 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.571057 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.571717 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.571993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.572266 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.582394 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.583805 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.594178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1405/2799] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:29:59.706114 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:29:59.707501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:29:59.720736 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829846d-7eae-460a-bd3e-0c671bb09c7c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:29:59.724502 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3d515-62a4-43a5-8ffb-f6f94920ad22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:29:59.725221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d515-62a4-43a5-8ffb-f6f94920ad22 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:29:59.725491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d515-62a4-43a5-8ffb-f6f94920ad22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:29:59.737235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3d515-62a4-43a5-8ffb-f6f94920ad22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:29:59.782965 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d515-62a4-43a5-8ffb-f6f94920ad22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:29:59.784399 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3d515-62a4-43a5-8ffb-f6f94920ad22 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:29:59.794044 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1395/2800] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:29:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:03.930645 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:03.992472 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804eb30-532b-4f7a-9903-05502408dd3e service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:03.997275 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:03.998154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:03.998433 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:03.998709 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] PATH_INFO: `/v3/users/3c0cc25fea6e4c3db85bc1b51d13eaef` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:03.999935 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0cc25fea6e4c3db85bc1b51d13eaef)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:04.001986 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:04.181830 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0cc25fea6e4c3db85bc1b51d13eaef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:04.237312 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0cc25fea6e4c3db85bc1b51d13eaef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:04.238180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0cc25fea6e4c3db85bc1b51d13eaef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:04.245765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0cc25fea6e4c3db85bc1b51d13eaef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:04.246403 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0cc25fea6e4c3db85bc1b51d13eaef'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:04.254700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:04.265941 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1406/2801] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:03 2022] DELETE /identity/v3/users/3c0cc25fea6e4c3db85bc1b51d13eaef => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:30:04.271185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:04.271185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:04.271185 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:04.291310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:04.292414 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:04.305848 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:04.354525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1396/2802] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:04.364702 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:04.366130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:04.429904 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e943a7-6b7d-44d4-8b12-38eab02ce1d1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:04.433690 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:04.434427 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:04.434714 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:04.435093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:04.444606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:04.446106 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:04.457745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1407/2803] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:04.857787 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:04.860418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:04.872450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09d96-bd83-4b8c-af9b-e0d4915632d6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:04.877797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:04.878658 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:04.878946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:04.879198 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] PATH_INFO: `/v3/projects/9ae9786e7b7f46b0a87bdb15b58bf4f8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:04.880368 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae9786e7b7f46b0a87bdb15b58bf4f8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:04.882306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:04.994979 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae9786e7b7f46b0a87bdb15b58bf4f8', 'request_id': 'req-65083577-4625-4e01-82ac-de26afaf7416'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.001479 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae9786e7b7f46b0a87bdb15b58bf4f8', 'request_id': 'req-65083577-4625-4e01-82ac-de26afaf7416'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.008810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae9786e7b7f46b0a87bdb15b58bf4f8', 'request_id': 'req-65083577-4625-4e01-82ac-de26afaf7416'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.071089 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] The token cache is being invalidate because project 9ae9786e7b7f46b0a87bdb15b58bf4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:05.071388 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.072020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.073617 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1397/2804] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:04 2022] DELETE /identity/v3/projects/9ae9786e7b7f46b0a87bdb15b58bf4f8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:05.079118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:05.088643 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6995a-3a87-4d73-9916-3a0b6370cd8e service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:05.147481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:05.148340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:05.148615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:05.148928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] PATH_INFO: `/v3/users/61fc5b07175e411d8e83f2281e689263` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:05.150114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fc5b07175e411d8e83f2281e689263)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:05.151991 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:05.348775 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fc5b07175e411d8e83f2281e689263'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.425756 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fc5b07175e411d8e83f2281e689263'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.426434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fc5b07175e411d8e83f2281e689263'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.433972 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fc5b07175e411d8e83f2281e689263'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.434613 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fc5b07175e411d8e83f2281e689263'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:05.452799 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1408/2805] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:05 2022] DELETE /identity/v3/users/61fc5b07175e411d8e83f2281e689263 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:05.873495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:05.879488 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:05.889543 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65083577-4625-4e01-82ac-de26afaf7416 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:05.949491 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:05.951381 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:05.951661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:05.951932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] PATH_INFO: `/v3/projects/a7e49e7df22f42a5b183e86d050520ee` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:05.953152 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e49e7df22f42a5b183e86d050520ee)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:05.955053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:06.062812 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:06.065593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e49e7df22f42a5b183e86d050520ee', 'request_id': 'req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.070892 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e49e7df22f42a5b183e86d050520ee', 'request_id': 'req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.078088 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e49e7df22f42a5b183e86d050520ee', 'request_id': 'req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.144287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] The token cache is being invalidate because project a7e49e7df22f42a5b183e86d050520ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:06.144537 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.145181 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.146731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1398/2806] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:05 2022] DELETE /identity/v3/projects/a7e49e7df22f42a5b183e86d050520ee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:06.150727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:06.152278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:06.166017 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac1557-6cfe-4873-9048-68a662ffdfd4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:06.176155 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:06.224708 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:06.225657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:06.225936 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:06.226209 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] PATH_INFO: `/v3/users/8db70a40bbcc44c19d5983d4eae5f08d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:06.227406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db70a40bbcc44c19d5983d4eae5f08d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:06.229358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:06.481397 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db70a40bbcc44c19d5983d4eae5f08d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.574231 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db70a40bbcc44c19d5983d4eae5f08d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.575007 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db70a40bbcc44c19d5983d4eae5f08d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.582370 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db70a40bbcc44c19d5983d4eae5f08d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.583015 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-dc284f7a-18da-40a2-8629-499e2e60a881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db70a40bbcc44c19d5983d4eae5f08d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:06.601760 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1409/2807] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:06 2022] DELETE /identity/v3/users/8db70a40bbcc44c19d5983d4eae5f08d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:06.995528 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:06.997568 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:07.014858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddec3d-e30a-4d51-92c0-d08b947b9cbc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:07.079406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:07.080278 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.080581 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.080897 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] PATH_INFO: `/v3/projects/b87069a87fde4aefadb83fc6e23bd55d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.082138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87069a87fde4aefadb83fc6e23bd55d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:07.084110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:07.209910 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87069a87fde4aefadb83fc6e23bd55d', 'request_id': 'req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:07.216021 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87069a87fde4aefadb83fc6e23bd55d', 'request_id': 'req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:07.222263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87069a87fde4aefadb83fc6e23bd55d', 'request_id': 'req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:07.338351 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] The token cache is being invalidate because project b87069a87fde4aefadb83fc6e23bd55d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:07.338579 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:07.339156 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ea9df1c1-a6dc-4153-9c6a-55a9873737d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:07.340739 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1399/2808] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:06 2022] DELETE /identity/v3/projects/b87069a87fde4aefadb83fc6e23bd55d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:07.346621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.347118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.347246 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.365655 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:07.366337 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:07.426505 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1410/2809] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:07.438310 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.438687 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.438870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.458700 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:07.459958 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:07.468942 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1400/2810] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:07.473171 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:07.483827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f54296-217f-4fd8-adc6-6e326ce77ee2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:07.488485 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:07.489154 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.489431 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.489700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.490406 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:30:07.490704 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:07.492262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:07.504352 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1411/2811] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:30:07.508844 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:07.518168 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a280-6994-4516-892a-98e396750e1d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:07.522988 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:07.523639 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.523923 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.524202 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.524930 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:07.526908 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:07.615787 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1401/2812] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:07.619817 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:07.630723 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d443-1f23-4a0b-b306-7411e5c6f8b1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:07.649122 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:07.688278 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:07.689059 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.689343 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.689619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.690309 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:07.692208 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:07.957838 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1412/2813] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:30:07 2022] POST /identity/v3/users => generated 287 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:07.962526 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:07.973743 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b5bc-e201-46b8-bcc6-f8fd60d7b617 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:07.978282 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:07.978932 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:07.979208 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:07.979481 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:07.980192 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:07.982874 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:07.994503 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1402/2814] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:07.999445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:08.009745 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd1639-598b-40f1-9f10-7892f800437b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:08.015366 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e535e3-ac18-4865-bc06-c11133985285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:08.016076 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e535e3-ac18-4865-bc06-c11133985285 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:08.016454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e535e3-ac18-4865-bc06-c11133985285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:08.016727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e535e3-ac18-4865-bc06-c11133985285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:08.017515 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e535e3-ac18-4865-bc06-c11133985285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:08.019131 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e535e3-ac18-4865-bc06-c11133985285 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:08.030576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1413/2815] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:08.035027 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:08.046052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe0a6-0440-41d1-87af-b28b8d75ff40 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:08.050694 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:08.051571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:08.051849 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:08.052122 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] PATH_INFO: `/v3/projects/2c91422363d149138ecf2d2d7140552c/users/731d07f9e1dd442f9142224456b69adc/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:08.067236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c91422363d149138ecf2d2d7140552c, user_id=731d07f9e1dd442f9142224456b69adc, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:08.069956 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:08.163261 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:08.168033 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1403/2816] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:08 2022] PUT /identity/v3/projects/2c91422363d149138ecf2d2d7140552c/users/731d07f9e1dd442f9142224456b69adc/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:08.174137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045fff-69aa-4617-86f7-f4485e270ed6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:08.174425 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045fff-69aa-4617-86f7-f4485e270ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:08.174700 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045fff-69aa-4617-86f7-f4485e270ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:08.192334 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-36045fff-69aa-4617-86f7-f4485e270ed6 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:08.193557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36045fff-69aa-4617-86f7-f4485e270ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:08.257029 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1414/2817] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:30:08.267598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:08.269348 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:08.327280 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff81e5-ef8a-4624-aa07-0e1fd649c854 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:08.331005 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:08.331642 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:08.331919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:08.332188 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:08.341919 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:08.343345 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:08.352646 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1404/2818] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:09.692123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:09.696640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:09.696640 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:09.721818 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] MFA Rules not processed for user `731d07f9e1dd442f9142224456b69adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:09.723050 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:09.798477 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1415/2819] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:09.803048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:09.814365 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9bd67-7f7a-48a9-9e15-c5fad2ee7adf service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:09.819022 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:09.819677 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:09.819957 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:09.820233 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:09.820936 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:09.822840 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:09.946308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1405/2820] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:30:09 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:09.956295 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:09.967297 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90841738-ccf2-4d39-a2ec-c81321859885 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:09.993245 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:10.024938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:10.025619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:10.025929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:10.026169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:10.026868 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:10.028994 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:10.100199 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1416/2821] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:30:09 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:10.104236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:10.115603 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515a8e9-2181-4fc5-adf8-6a7d5786248a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:10.120271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:10.121026 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:10.121902 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:10.122473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:10.123201 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:10.124872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:10.140307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1406/2822] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:10.145620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:10.164576 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cfca7-7bd5-4ba6-82f6-5a8cb3922876 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:10.172956 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:10.173862 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:10.174138 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:10.174411 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] PATH_INFO: `/v3/projects/53c17077e0ba453d905c6942166cd62c/users/6b2bb5bc0f2a440abc357cdf7124631a/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:10.196134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c17077e0ba453d905c6942166cd62c, user_id=6b2bb5bc0f2a440abc357cdf7124631a, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:10.199113 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:10.271000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1417/2823] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:10 2022] PUT /identity/v3/projects/53c17077e0ba453d905c6942166cd62c/users/6b2bb5bc0f2a440abc357cdf7124631a/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:10.276155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:10.287906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ecde9-2ca1-4342-9117-06e60f0caa7e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:10.351572 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0057c-cc89-49b4-b69b-d72a952f443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:10.352240 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0057c-cc89-49b4-b69b-d72a952f443d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:10.352525 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0057c-cc89-49b4-b69b-d72a952f443d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:10.352823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0057c-cc89-49b4-b69b-d72a952f443d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:10.353551 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0057c-cc89-49b4-b69b-d72a952f443d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:10.355157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0057c-cc89-49b4-b69b-d72a952f443d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:10.365824 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1407/2824] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:10.371697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:10.383013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284b8ff-4b28-4eaf-accb-b4aba19b2a12 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:10.387958 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:10.388912 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:10.389196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:10.389469 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] PATH_INFO: `/v3/projects/53c17077e0ba453d905c6942166cd62c/users/6b2bb5bc0f2a440abc357cdf7124631a/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:10.391641 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c17077e0ba453d905c6942166cd62c, user_id=6b2bb5bc0f2a440abc357cdf7124631a, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:10.394422 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:10.408090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1418/2825] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:10 2022] PUT /identity/v3/projects/53c17077e0ba453d905c6942166cd62c/users/6b2bb5bc0f2a440abc357cdf7124631a/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:30:11.787495 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:11.788251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:11.788595 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:11.824418 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] MFA Rules not processed for user `6b2bb5bc0f2a440abc357cdf7124631a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:11.825707 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:11.900109 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:11.923438 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1408/2826] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:11.937283 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:11.939026 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:12.001446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579a98c-2a36-480c-ae62-a192ef4bfd88 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:12.005025 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:12.005670 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:12.005955 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:12.006229 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:12.063405 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:12.064746 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:12.073586 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1419/2827] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:13.735435 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:13.736851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:13.749166 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdda24-7d5f-4bdc-a719-bbc7518dd8d1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:13.752947 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:13.753702 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:13.753990 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:13.754268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:13.764263 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:13.765754 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:13.775447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1409/2828] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:22.069592 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:23.771149 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:29.701147 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:29.766227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b2988-01f0-443a-9d79-47bfbea40142 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:29.772276 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:29.773169 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:29.773606 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:29.773878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] PATH_INFO: `/v3/users/731d07f9e1dd442f9142224456b69adc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:29.775051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] RBAC: Authorizing `identity:delete_user(user_id=731d07f9e1dd442f9142224456b69adc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:29.778037 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:29.999930 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731d07f9e1dd442f9142224456b69adc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.071516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731d07f9e1dd442f9142224456b69adc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.072183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731d07f9e1dd442f9142224456b69adc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.084358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731d07f9e1dd442f9142224456b69adc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.085551 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731d07f9e1dd442f9142224456b69adc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.110439 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1420/2829] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:29 2022] DELETE /identity/v3/users/731d07f9e1dd442f9142224456b69adc => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:30.353987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:30.364649 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b2a18-8be8-4f7a-8c36-a925a791c751 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:30.430230 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:30.431139 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:30.431422 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:30.431701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] PATH_INFO: `/v3/projects/2c91422363d149138ecf2d2d7140552c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:30.432972 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c91422363d149138ecf2d2d7140552c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:30.434933 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:30.534731 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c91422363d149138ecf2d2d7140552c', 'request_id': 'req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.541629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c91422363d149138ecf2d2d7140552c', 'request_id': 'req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.548015 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c91422363d149138ecf2d2d7140552c', 'request_id': 'req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.619482 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] The token cache is being invalidate because project 2c91422363d149138ecf2d2d7140552c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:30.619693 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.620291 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:30.621898 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1410/2830] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:30 2022] DELETE /identity/v3/projects/2c91422363d149138ecf2d2d7140552c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:30.625938 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:30.627368 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:30.642693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2cacc5-39f5-4723-8b27-589405f0480b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:30.700126 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:30.701033 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:30.701319 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:30.701870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] PATH_INFO: `/v3/users/6b2bb5bc0f2a440abc357cdf7124631a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:30.702770 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2bb5bc0f2a440abc357cdf7124631a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:30.704715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:30.726568 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:30.937034 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2bb5bc0f2a440abc357cdf7124631a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.002803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2bb5bc0f2a440abc357cdf7124631a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.003448 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2bb5bc0f2a440abc357cdf7124631a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.013990 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2bb5bc0f2a440abc357cdf7124631a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.014731 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-91711d0a-87fa-4db3-91fc-aec537f08c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2bb5bc0f2a440abc357cdf7124631a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.034733 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1421/2831] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:30 2022] DELETE /identity/v3/users/6b2bb5bc0f2a440abc357cdf7124631a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:30:31.328194 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:31.331378 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:31.344986 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1ca06-87e3-4a5e-b671-9c564bcab4a8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:31.412382 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:31.413511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:31.413801 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:31.414150 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] PATH_INFO: `/v3/projects/53c17077e0ba453d905c6942166cd62c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:31.415638 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c17077e0ba453d905c6942166cd62c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:31.417634 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:31.525042 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:31.539395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c17077e0ba453d905c6942166cd62c', 'request_id': 'req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.545052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c17077e0ba453d905c6942166cd62c', 'request_id': 'req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.553606 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c17077e0ba453d905c6942166cd62c', 'request_id': 'req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.679008 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] The token cache is being invalidate because project 53c17077e0ba453d905c6942166cd62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:31.679311 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.680002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0fc3d3ef-8bf2-4fbe-ad57-dac7ac4f4760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:31.681778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1411/2832] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:31 2022] DELETE /identity/v3/projects/53c17077e0ba453d905c6942166cd62c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:31.687260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:31.687663 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:31.688049 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:31.709361 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:31.711242 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:31.790716 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1422/2833] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:31.800146 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:31.800433 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:31.800712 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:31.821629 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:31.822922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:31.831768 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1412/2834] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:31.837656 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:31.847940 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561601f-9dd8-4fd6-8da5-a6c94f544793 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:31.853301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:31.853968 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:31.854251 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:31.854521 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:31.855240 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:30:31.855538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:31.857218 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:31.870065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1423/2835] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:30:31.874601 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:31.885126 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7694-2493-4321-bbd7-74c56e44c014 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:31.889984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:31.890654 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:31.890961 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:31.891214 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:31.891903 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:31.893853 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:31.987586 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1413/2836] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:30:31 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:31.992928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.003520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c07f4-67d4-4430-baeb-b0ecb6e05fdb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:32.067523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:32.068680 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.069110 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.069286 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.069933 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:32.071853 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:32.192090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1424/2837] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:30:31 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:32.197158 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.208391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93478-7ccb-4415-9853-88235b4e0292 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:32.213293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:32.213984 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.214288 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.214563 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.215293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:32.216969 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:32.229713 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1414/2838] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:32.234202 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.245703 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8dc0-3d8a-4389-859b-4c7401283fcd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:32.251178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92c1f-2330-4639-b0bc-b0a4cd190497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:32.251852 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92c1f-2330-4639-b0bc-b0a4cd190497 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.252134 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92c1f-2330-4639-b0bc-b0a4cd190497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.253248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92c1f-2330-4639-b0bc-b0a4cd190497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.253248 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92c1f-2330-4639-b0bc-b0a4cd190497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:32.254922 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e92c1f-2330-4639-b0bc-b0a4cd190497 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:32.268398 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1425/2839] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:32.273165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.284079 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5c8f-9783-40be-99fb-5fb491389ebd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:32.288922 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:32.289805 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.290093 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.290369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] PATH_INFO: `/v3/projects/35a9d38ea0254bac922b3f46640f6300/users/a1d295a5f16048569c077455bd15ea4e/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.310795 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a9d38ea0254bac922b3f46640f6300, user_id=a1d295a5f16048569c077455bd15ea4e, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:32.313630 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:32.420498 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1415/2840] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:32 2022] PUT /identity/v3/projects/35a9d38ea0254bac922b3f46640f6300/users/a1d295a5f16048569c077455bd15ea4e/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:32.486599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.487021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.487292 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.495178 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:32.516726 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] MFA Rules not processed for user `a1d295a5f16048569c077455bd15ea4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:32.518000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:32.594211 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1426/2841] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:32.598872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.666559 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c50be-8fce-4f6d-8c32-63980cd51cde admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:32.671403 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:32.672020 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.672299 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.672571 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.673284 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:32.675232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:32.765862 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1416/2842] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:30:32 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:30:32.770051 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.784707 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb5e78-a278-4ef5-9337-0adb5730c6ab None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:32.858728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:32.860168 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:32.860465 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:32.860743 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:32.861540 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:32.863481 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:32.981757 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1427/2843] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:30:32 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:30:32.985689 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:32.996170 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d657-3be2-4c08-9aa5-ed9209408112 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.000810 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.001550 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.001827 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.002100 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.002832 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.004475 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:33.016257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1417/2844] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:33.020450 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:33.034668 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6ac23-db12-401d-9a70-cbc0fe1c3bf7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.040769 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc84dc8-efab-449b-bdf8-cf24bf4920cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.041463 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84dc8-efab-449b-bdf8-cf24bf4920cc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.041774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84dc8-efab-449b-bdf8-cf24bf4920cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.042166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc84dc8-efab-449b-bdf8-cf24bf4920cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.043048 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc84dc8-efab-449b-bdf8-cf24bf4920cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.044674 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc84dc8-efab-449b-bdf8-cf24bf4920cc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:33.055842 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1428/2845] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:33.060293 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:33.072764 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298787c-f082-4a2d-8c42-969e511bc1fd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.077615 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.078501 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.078778 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.079048 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] PATH_INFO: `/v3/projects/950b0daa5da24ef0b3abbcdc3c83790a/users/5cfeb15128c4419cac2659024526453a/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.096635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=950b0daa5da24ef0b3abbcdc3c83790a, user_id=5cfeb15128c4419cac2659024526453a, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.100036 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:33.186124 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1418/2846] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:33 2022] PUT /identity/v3/projects/950b0daa5da24ef0b3abbcdc3c83790a/users/5cfeb15128c4419cac2659024526453a/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:30:33.196847 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.197301 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.197696 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.230306 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] MFA Rules not processed for user `5cfeb15128c4419cac2659024526453a`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:33.231554 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:33.330179 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1429/2847] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:33.335823 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:33.345851 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:33.411379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2e58-e5f5-4b57-87c6-eb88c5aa5cbe admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.417589 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.418490 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.418618 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.418889 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.419608 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.421711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:33.579341 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1419/2848] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:30:33 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:30:33.587471 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:33.593262 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:33.600006 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b06ae8-7f65-431c-9c7a-faa33ff53447 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.673021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.673711 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.674186 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.674460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.675145 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.677720 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:33.827675 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1430/2849] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:30:33 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 14:30:33.835660 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:33.846369 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695f5fa-7d02-4f0d-a4a3-279d5db64be2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.852450 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.853157 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.853441 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.853716 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.854457 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.856073 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:33.868306 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1420/2850] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:33.872522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:33.886221 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1f9d6-deb1-465a-8526-e43b7753a296 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:33.891019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:33.891906 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:33.892180 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:33.892454 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] PATH_INFO: `/v3/projects/b40182ed5f644529a54cad936b118e4d/users/3d2efc121d7843329afa1efc6473657d/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:33.913993 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40182ed5f644529a54cad936b118e4d, user_id=3d2efc121d7843329afa1efc6473657d, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:33.916751 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:34.019146 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1431/2851] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:33 2022] PUT /identity/v3/projects/b40182ed5f644529a54cad936b118e4d/users/3d2efc121d7843329afa1efc6473657d/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:30:34.024257 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:34.042356 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001a456-4843-483b-b583-cffa25d2f3d7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:34.119074 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63366aac-36b8-49fa-87d2-5e571eb726f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:34.119678 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366aac-36b8-49fa-87d2-5e571eb726f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:34.119976 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366aac-36b8-49fa-87d2-5e571eb726f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:34.120251 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63366aac-36b8-49fa-87d2-5e571eb726f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:34.121065 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366aac-36b8-49fa-87d2-5e571eb726f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:34.122701 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63366aac-36b8-49fa-87d2-5e571eb726f9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:34.136711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1421/2852] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:34.140959 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:34.152619 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f022-ae7e-4aa7-b02a-533cda68e494 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:34.158013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:34.158915 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:34.159191 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:34.159461 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] PATH_INFO: `/v3/projects/b40182ed5f644529a54cad936b118e4d/users/3d2efc121d7843329afa1efc6473657d/roles/264bc025e3d84d9ebb870cc70b4a213a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:34.162080 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40182ed5f644529a54cad936b118e4d, user_id=3d2efc121d7843329afa1efc6473657d, role_id=264bc025e3d84d9ebb870cc70b4a213a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:34.165446 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:34.178616 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1432/2853] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:34 2022] PUT /identity/v3/projects/b40182ed5f644529a54cad936b118e4d/users/3d2efc121d7843329afa1efc6473657d/roles/264bc025e3d84d9ebb870cc70b4a213a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:34.190593 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:34.190906 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:34.191186 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:34.221273 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] MFA Rules not processed for user `3d2efc121d7843329afa1efc6473657d`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:34.222508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:34.308432 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1422/2854] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:30:34.321604 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:34.323452 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:34.394657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcce865-af52-463e-90f6-1c7f826c9fd6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:34.399660 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:34.400340 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:34.400621 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:34.400927 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:34.469068 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:34.470715 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:34.481774 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1433/2855] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:30:36.644002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:36.645444 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:36.653001 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:36.659138 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3768a8-439a-4f9a-82e8-b78e490432f7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:36.663094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:36.669212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:36.669212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:36.669212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:36.729987 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:36.731598 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:36.743287 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1423/2856] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:38.925880 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:38.936516 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479faf-f93b-4eec-8736-f9617e2bf806 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:38.940356 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3dc4c-2349-4b84-8883-ed17371a533e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e898dd74aefe470ab60a8dc9a066f6f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:38.947954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3dc4c-2349-4b84-8883-ed17371a533e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:38.947954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3dc4c-2349-4b84-8883-ed17371a533e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:38.947954 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3dc4c-2349-4b84-8883-ed17371a533e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:38.950044 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:38.952571 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3dc4c-2349-4b84-8883-ed17371a533e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:38.954140 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3dc4c-2349-4b84-8883-ed17371a533e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:38.965727 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1434/2857] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:44.106385 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:44.191785 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beef5f-1d22-4d26-98f1-ddba793e529e service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:44.197718 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:44.198604 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:44.198891 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:44.199292 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] PATH_INFO: `/v3/users/a1d295a5f16048569c077455bd15ea4e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:44.200428 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d295a5f16048569c077455bd15ea4e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:44.202421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:44.442325 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d295a5f16048569c077455bd15ea4e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:44.443012 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d295a5f16048569c077455bd15ea4e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:44.443621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d295a5f16048569c077455bd15ea4e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:44.528239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d295a5f16048569c077455bd15ea4e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:44.542625 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d295a5f16048569c077455bd15ea4e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:44.556370 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1424/2858] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:44 2022] DELETE /identity/v3/users/a1d295a5f16048569c077455bd15ea4e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:44.561177 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:44.563212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:44.563212 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:44.582090 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:44.583308 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:44.648013 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1435/2859] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:44.667697 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:44.669249 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:44.691680 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:44.730471 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec0d17-627e-470d-a857-91d2ad54e3dc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:44.734445 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:44.735121 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:44.735426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:44.735704 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:44.746560 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:44.750235 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:44.759635 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1425/2860] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:30:45.208078 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:45.209965 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:45.223220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ad9ee-bccc-4b30-bb48-a1eafd413288 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:45.231367 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:45.232362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:45.235112 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:45.235437 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] PATH_INFO: `/v3/projects/35a9d38ea0254bac922b3f46640f6300` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:45.241950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a9d38ea0254bac922b3f46640f6300)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:45.242615 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:45.389864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a9d38ea0254bac922b3f46640f6300', 'request_id': 'req-b1e052fb-8bde-4008-99ff-56ef3c43c708'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.480759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a9d38ea0254bac922b3f46640f6300', 'request_id': 'req-b1e052fb-8bde-4008-99ff-56ef3c43c708'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.490372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a9d38ea0254bac922b3f46640f6300', 'request_id': 'req-b1e052fb-8bde-4008-99ff-56ef3c43c708'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.502885 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] The token cache is being invalidate because project 35a9d38ea0254bac922b3f46640f6300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:45.503338 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.504040 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.505829 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1436/2861] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:45 2022] DELETE /identity/v3/projects/35a9d38ea0254bac922b3f46640f6300 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:45.512092 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:45.521516 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7a17f-ab9b-448f-8fc9-586f7033d391 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:45.601389 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:45.602383 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:45.602661 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:45.602935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] PATH_INFO: `/v3/users/5cfeb15128c4419cac2659024526453a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:45.604298 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfeb15128c4419cac2659024526453a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:45.606776 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:45.818811 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfeb15128c4419cac2659024526453a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.820715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfeb15128c4419cac2659024526453a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.821500 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfeb15128c4419cac2659024526453a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.920856 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfeb15128c4419cac2659024526453a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.935960 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfeb15128c4419cac2659024526453a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:45.949302 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1426/2862] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:45 2022] DELETE /identity/v3/users/5cfeb15128c4419cac2659024526453a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:46.434801 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:46.437372 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:46.456870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e052fb-8bde-4008-99ff-56ef3c43c708 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:46.540114 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:46.541072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:46.541488 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:46.541765 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] PATH_INFO: `/v3/projects/950b0daa5da24ef0b3abbcdc3c83790a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:46.543099 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950b0daa5da24ef0b3abbcdc3c83790a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:46.545065 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:46.575753 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:46.667166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950b0daa5da24ef0b3abbcdc3c83790a', 'request_id': 'req-a4b7987e-75d6-4bf7-8162-0e587bfd4773'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:46.768137 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950b0daa5da24ef0b3abbcdc3c83790a', 'request_id': 'req-a4b7987e-75d6-4bf7-8162-0e587bfd4773'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:46.775628 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950b0daa5da24ef0b3abbcdc3c83790a', 'request_id': 'req-a4b7987e-75d6-4bf7-8162-0e587bfd4773'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:46.787914 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] The token cache is being invalidate because project 950b0daa5da24ef0b3abbcdc3c83790a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:46.788298 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:46.788982 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:46.790525 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1437/2863] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:46 2022] DELETE /identity/v3/projects/950b0daa5da24ef0b3abbcdc3c83790a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:46.794473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:46.795963 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:46.813308 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e41d-b228-4c44-b1aa-a336f35f5f53 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:46.861918 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:46.885211 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:46.886236 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:46.886521 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:46.886797 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] PATH_INFO: `/v3/users/3d2efc121d7843329afa1efc6473657d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:46.888009 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2efc121d7843329afa1efc6473657d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:46.889971 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:47.113484 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2efc121d7843329afa1efc6473657d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:47.114091 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2efc121d7843329afa1efc6473657d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:47.114715 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2efc121d7843329afa1efc6473657d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:47.213622 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2efc121d7843329afa1efc6473657d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:47.227255 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9fabc8fb-6ea5-4480-9d89-a919bd33e902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2efc121d7843329afa1efc6473657d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:47.241607 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1427/2864] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:30:46 2022] DELETE /identity/v3/users/3d2efc121d7843329afa1efc6473657d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:30:47.705807 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:47.708032 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:47.731960 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7987e-75d6-4bf7-8162-0e587bfd4773 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:47.794369 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:47.795227 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:47.795503 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:47.795773 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] PATH_INFO: `/v3/projects/b40182ed5f644529a54cad936b118e4d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:47.796992 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40182ed5f644529a54cad936b118e4d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:47.798928 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:47.921665 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40182ed5f644529a54cad936b118e4d', 'request_id': 'req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:48.002579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40182ed5f644529a54cad936b118e4d', 'request_id': 'req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:48.009803 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40182ed5f644529a54cad936b118e4d', 'request_id': 'req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:48.021724 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] The token cache is being invalidate because project b40182ed5f644529a54cad936b118e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:30:48.022035 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:48.022697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cf6a4a24-4ac7-47d3-b5e1-a18dcfe7a329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:30:48.024235 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1438/2865] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:30:47 2022] DELETE /identity/v3/projects/b40182ed5f644529a54cad936b118e4d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:48.030155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.030706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.030706 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.049633 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:48.050866 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:48.114555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1428/2866] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:48.122919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.123272 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.123561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.145193 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:48.146434 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:48.155213 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1439/2867] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:48.159809 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.170359 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520a8c-37d3-42d2-bdc4-12dfc6e9b862 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:48.175155 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:48.175816 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.176099 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.176377 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.177154 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 14:30:48.177460 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:48.179614 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:48.191872 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1429/2868] 10.222.0.71 () {58 vars in 1152 bytes} [Wed May 18 14:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 14:30:48.197599 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.207056 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e417-45ba-429b-ae66-b4e147870d4e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:48.212500 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:48.213241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.213523 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.213810 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.214504 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:48.216407 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:48.301002 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1440/2869] 10.222.0.71 () {60 vars in 1152 bytes} [Wed May 18 14:30:48 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:48.306406 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.317948 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68845778-60b0-489c-8d9e-ede3861eb474 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:48.378573 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:48.392256 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:48.392950 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.393232 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.393505 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.394195 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:48.396098 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:48.562656 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1430/2870] 10.222.0.71 () {60 vars in 1143 bytes} [Wed May 18 14:30:48 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 14:30:48.566737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.578310 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f8bb-4983-4b1a-8293-ee74038c3e29 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:48.582931 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:48.583664 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.583946 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.584220 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.585350 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:48.586999 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:48.593083 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:48.598869 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1441/2871] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 14:30:48.603641 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.614117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23fb19-a848-4423-a8f8-d90028c5bd59 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:48.621437 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9699c62-65f8-48c4-ab2f-80104dfb4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:48.622112 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699c62-65f8-48c4-ab2f-80104dfb4bae admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.622394 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699c62-65f8-48c4-ab2f-80104dfb4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.622667 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9699c62-65f8-48c4-ab2f-80104dfb4bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.623426 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9699c62-65f8-48c4-ab2f-80104dfb4bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:48.625069 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9699c62-65f8-48c4-ab2f-80104dfb4bae admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:48.637576 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1431/2872] 10.222.0.71 () {58 vars in 1121 bytes} [Wed May 18 14:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 14:30:48.641952 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.653693 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26541c-4adf-4a74-a207-a8ee75ac26ae admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:48.659072 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:48.659944 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.660223 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.660528 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] PATH_INFO: `/v3/projects/f5cac1427aae409ebca10726ad68f188/users/6f0439ced72040c8af71d4ce5d34121d/roles/fdc0b94e97b748159f3e6d678394e34e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.682464 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cac1427aae409ebca10726ad68f188, user_id=6f0439ced72040c8af71d4ce5d34121d, role_id=fdc0b94e97b748159f3e6d678394e34e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:48.685507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:48.814737 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1442/2873] 10.222.0.71 () {60 vars in 1482 bytes} [Wed May 18 14:30:48 2022] PUT /identity/v3/projects/f5cac1427aae409ebca10726ad68f188/users/6f0439ced72040c8af71d4ce5d34121d/roles/fdc0b94e97b748159f3e6d678394e34e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:30:48.834657 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:48.835110 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:48.835412 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:48.864567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] MFA Rules not processed for user `6f0439ced72040c8af71d4ce5d34121d`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:30:48.866465 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:48.938031 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1432/2874] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:30:48.951014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:30:48.952884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:30:49.045497 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec2464-7b8e-4f48-adb8-a9d502f3f6e6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:30:49.049241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710218c1-c095-4314-8ad0-a719777f3e49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fecaff6430634c0ba90cd9039c2a9775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:30:49.049894 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710218c1-c095-4314-8ad0-a719777f3e49 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:30:49.050183 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710218c1-c095-4314-8ad0-a719777f3e49 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:30:49.050459 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710218c1-c095-4314-8ad0-a719777f3e49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:30:49.060239 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710218c1-c095-4314-8ad0-a719777f3e49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:30:49.061876 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710218c1-c095-4314-8ad0-a719777f3e49 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:30:49.072520 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1443/2875] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:30:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:30:58.934567 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:30:59.067133 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:31:19.606616 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:31:19.669792 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15110-b0d0-4f61-9086-4dcfff9e7216 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:31:19.674307 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:31:19.675165 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:19.675447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:19.675720 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] PATH_INFO: `/v3/users/6f0439ced72040c8af71d4ce5d34121d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:19.676935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0439ced72040c8af71d4ce5d34121d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:31:19.678870 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:31:19.842231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0439ced72040c8af71d4ce5d34121d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:19.842231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0439ced72040c8af71d4ce5d34121d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:19.842231 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0439ced72040c8af71d4ce5d34121d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:19.892864 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0439ced72040c8af71d4ce5d34121d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:19.906379 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0439ced72040c8af71d4ce5d34121d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:19.918511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1433/2876] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:31:19 2022] DELETE /identity/v3/users/6f0439ced72040c8af71d4ce5d34121d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:31:19.923638 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:19.924130 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:19.924241 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:19.941635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] MFA Rules not processed for user `532c808ad3044d808c9b3565bd851ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:31:19.942836 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:20.000857 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1444/2877] 10.222.0.71 () {58 vars in 957 bytes} [Wed May 18 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:31:20.011095 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:31:20.013800 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:20.072770 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dd263-751f-4d57-90fb-f1ace13f78fd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:31:20.077142 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:31:20.077880 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:20.078212 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:20.078555 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:20.088711 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:31:20.090183 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:31:20.101374 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1434/2878] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:31:20.557635 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:31:20.559100 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:20.578020 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686e2c-69ed-4f42-988f-b3a9aef3495b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:31:20.578790 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:31:20.579732 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:20.580084 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:20.580522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] PATH_INFO: `/v3/projects/f5cac1427aae409ebca10726ad68f188` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:20.581950 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cac1427aae409ebca10726ad68f188)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:31:20.584041 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:31:20.777657 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cac1427aae409ebca10726ad68f188', 'request_id': 'req-cd1cf134-550b-4371-aa95-e72a3a9e1e51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:20.869921 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cac1427aae409ebca10726ad68f188', 'request_id': 'req-cd1cf134-550b-4371-aa95-e72a3a9e1e51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:20.876913 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cac1427aae409ebca10726ad68f188', 'request_id': 'req-cd1cf134-550b-4371-aa95-e72a3a9e1e51'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:20.888579 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] The token cache is being invalidate because project f5cac1427aae409ebca10726ad68f188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:31:20.893079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:20.893079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cd1cf134-550b-4371-aa95-e72a3a9e1e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:31:20.893079 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1445/2879] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:31:20 2022] DELETE /identity/v3/projects/f5cac1427aae409ebca10726ad68f188 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:31:30.097107 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:31:30.885620 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:31:32.770030 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:31:32.771468 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:32.866117 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b5a3d-f388-4410-87ae-a373e0533574 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:31:32.928997 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:31:32.929662 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:32.929945 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:32.930227 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:32.932118 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:32.945404 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:31:32.947019 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e24b2-ea26-43db-b610-5242d3659a75 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:31:32.958286 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1435/2880] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:31:34.599538 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99e6e-75ed-4fa1-b2d9-b2172d6df268 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:34.600219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99e6e-75ed-4fa1-b2d9-b2172d6df268 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:34.600219 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e99e6e-75ed-4fa1-b2d9-b2172d6df268 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:34.601623 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1446/2881] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:31:34.608025 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f572f-87c1-463e-ab1d-03f0717a5cd7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:34.608517 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f572f-87c1-463e-ab1d-03f0717a5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:34.608621 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f572f-87c1-463e-ab1d-03f0717a5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:34.661759 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-093f572f-87c1-463e-ab1d-03f0717a5cd7 None None] MFA Rules not processed for user `2673e2410816490896bc0c6835005e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:31:34.663000 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-093f572f-87c1-463e-ab1d-03f0717a5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:34.714070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:31:34.720935 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1436/2882] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 14:31:34.733105 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99e6e-75ed-4fa1-b2d9-b2172d6df268 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:31:34.734919 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90e99e6e-75ed-4fa1-b2d9-b2172d6df268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:34.748085 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e99e6e-75ed-4fa1-b2d9-b2172d6df268 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:31:34.752226 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e82104-20c4-458c-b656-7d7e08070e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:31:34.752887 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82104-20c4-458c-b656-7d7e08070e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:34.753170 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82104-20c4-458c-b656-7d7e08070e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:34.753442 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e82104-20c4-458c-b656-7d7e08070e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:34.760870 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e82104-20c4-458c-b656-7d7e08070e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:31:34.762290 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e82104-20c4-458c-b656-7d7e08070e60 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:31:34.771021 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1447/2883] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:31:34.856221 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728a433-45d7-4e74-8116-a4160936cb59 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:34.856511 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728a433-45d7-4e74-8116-a4160936cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:34.856808 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728a433-45d7-4e74-8116-a4160936cb59 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:34.858238 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1437/2884] 10.222.0.71 () {54 vars in 921 bytes} [Wed May 18 14:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 14:31:34.864296 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:34.864580 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:34.864882 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:34.914929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] MFA Rules not processed for user `bd1a4928c641445e8b78a2836c680536`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 14:31:34.916166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:34.982759 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1448/2885] 10.222.0.71 () {58 vars in 1018 bytes} [Wed May 18 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 14:31:34.993531 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728a433-45d7-4e74-8116-a4160936cb59 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:31:34.995161 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d728a433-45d7-4e74-8116-a4160936cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:31:35.009169 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728a433-45d7-4e74-8116-a4160936cb59 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:31:35.012858 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:31:35.013440 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:31:35.013722 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:31:35.014002 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:31:35.025239 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:31:35.026791 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:31:35.038396 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1438/2886] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:31:44.973396 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=48 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:31:45.033717 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:33:10.462093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:10.462093 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:10.474507 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8cccd-0015-4611-bbcf-14de075f8841 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:10.481428 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd1a4928c641445e8b78a2836c680536', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:10.482166 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:10.482522 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:10.482881 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:10.484884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:10.498806 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:10.500395 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:10.512901 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1449/2887] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:33:10.841850 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:10.852209 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d788b30-8ba9-4957-a6cb-33829a7e5ec8 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:10.856053 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:10.856937 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:10.857199 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:10.857628 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:10.859446 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:10.874167 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:10.876611 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:10.888059 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1439/2888] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:33:12.076984 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:12.086929 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839f5f-ab20-42fd-b63a-475c2979dd20 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:12.090611 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:12.091253 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:12.091537 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:12.091820 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:12.094574 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:12.109973 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:12.112156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:12.124728 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1450/2889] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:33:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 14:33:16.859148 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:16.867884 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd553163-a469-4a80-9b48-ed59afa62412 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:16.871515 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2673e2410816490896bc0c6835005e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:16.872129 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:16.872405 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:16.872673 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:16.874529 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:16.937946 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:16.939391 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:16.950090 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1440/2890] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:33:22.118019 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=12 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:33:24.039330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:24.040989 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:24.058118 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427ddfb-c8b7-4736-b51e-1754f54fdf57 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:24.063259 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:24.064123 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:24.064400 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:24.064669 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] PATH_INFO: `/v3/users/5f0656b31b5f4cbd8912b1a0aba928cc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:24.065864 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0656b31b5f4cbd8912b1a0aba928cc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:24.067884 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:24.304460 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0656b31b5f4cbd8912b1a0aba928cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.387527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0656b31b5f4cbd8912b1a0aba928cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.388156 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0656b31b5f4cbd8912b1a0aba928cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.397330 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0656b31b5f4cbd8912b1a0aba928cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.398303 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0656b31b5f4cbd8912b1a0aba928cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.417281 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1451/2891] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:33:24 2022] DELETE /identity/v3/users/5f0656b31b5f4cbd8912b1a0aba928cc => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:33:24.676064 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:24.687970 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8398d-663b-4222-9899-9de8015e6489 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:24.749566 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:24.750473 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:24.750749 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:24.751052 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] PATH_INFO: `/v3/projects/dd4e2f9843b84aebb963f491048a331a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:24.752395 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4e2f9843b84aebb963f491048a331a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:24.754373 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:24.867777 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4e2f9843b84aebb963f491048a331a', 'request_id': 'req-e8c43a86-d554-410c-87d5-590a4ee2a7cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.874271 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4e2f9843b84aebb963f491048a331a', 'request_id': 'req-e8c43a86-d554-410c-87d5-590a4ee2a7cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.880577 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4e2f9843b84aebb963f491048a331a', 'request_id': 'req-e8c43a86-d554-410c-87d5-590a4ee2a7cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.970268 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] The token cache is being invalidate because project dd4e2f9843b84aebb963f491048a331a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:33:24.970508 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.971160 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:24.972772 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1441/2892] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:33:24 2022] DELETE /identity/v3/projects/dd4e2f9843b84aebb963f491048a331a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 14:33:24.976697 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:24.978260 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:24.992111 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e0c87-fbd9-4bfd-8dab-75f19ed5d3b6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:25.052888 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:25.053764 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:25.054047 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:25.054335 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] PATH_INFO: `/v3/users/59ba98f0d10543c8814b249c5e53ab35` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:25.055527 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ba98f0d10543c8814b249c5e53ab35)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:25.057484 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:25.229878 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ba98f0d10543c8814b249c5e53ab35'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.304831 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ba98f0d10543c8814b249c5e53ab35'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.305445 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ba98f0d10543c8814b249c5e53ab35'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.313561 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ba98f0d10543c8814b249c5e53ab35'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.314196 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ba98f0d10543c8814b249c5e53ab35'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.322358 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:33:25.332089 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1452/2893] 10.222.0.71 () {58 vars in 1223 bytes} [Wed May 18 14:33:24 2022] DELETE /identity/v3/users/59ba98f0d10543c8814b249c5e53ab35 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:33:25.575813 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:33:25.577774 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:33:25.590597 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c43a86-d554-410c-87d5-590a4ee2a7cd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:33:25.598909 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:33:25.648447 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532c808ad3044d808c9b3565bd851ce1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cac9ce8241ae4db2ae909b6e0401b3f2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:33:25.649398 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:33:25.649894 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:33:25.650387 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] PATH_INFO: `/v3/projects/cf2664cbad244f59861042b2060d3d59` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:33:25.652514 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2664cbad244f59861042b2060d3d59)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:33:25.654538 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:33:25.759215 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2664cbad244f59861042b2060d3d59', 'request_id': 'req-6f77413a-6715-4339-9c79-9c760b604a42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.765094 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2664cbad244f59861042b2060d3d59', 'request_id': 'req-6f77413a-6715-4339-9c79-9c760b604a42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.771846 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2664cbad244f59861042b2060d3d59', 'request_id': 'req-6f77413a-6715-4339-9c79-9c760b604a42'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.838177 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] The token cache is being invalidate because project cf2664cbad244f59861042b2060d3d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 14:33:25.838461 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.839070 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f77413a-6715-4339-9c79-9c760b604a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 14:33:25.841421 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1442/2894] 10.222.0.71 () {58 vars in 1232 bytes} [Wed May 18 14:33:25 2022] DELETE /identity/v3/projects/cf2664cbad244f59861042b2060d3d59 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 14:33:35.459045 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:33:35.835086 dv-cinder-755101-9-iscsi devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 14:36:38.559331 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 14:36:38.560827 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:36:38.630378 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1dc3-9673-43a6-864a-7224f1e8c715 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 14:36:38.692313 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d5153b7c1af4b7285ada5dba9316416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3338208b8c184f118998b6d48d699410', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 14:36:38.693000 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 14:36:38.693284 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 14:36:38.693557 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 14:36:38.695362 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 14:36:38.707414 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 14:36:38.709014 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d495e36-0892-4fbe-9e4b-eba3f12357d6 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 14:36:38.719740 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1453/2895] 10.222.0.71 () {60 vars in 1365 bytes} [Wed May 18 14:36:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 14:36:48.715441 dv-cinder-755101-9-iscsi devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=58 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}